Databricks

Great new launch from the Databricks AI team! We trained a document parsing system that delivers leading quality at 3-5x lower cost and outperforms frontier models like GPT-5 and Claude. https://lnkd.in/gJA8cTTi This is critical to connect AI to so many kinds of data that is locked in PDFs and other documents. We parse each document into a nice JSON format, including tables, text, and even figure descriptions, which you can then feed into AI agents or downstream apps. We also made it super easy to use from SQL or Apache Spark. Just call ai_parse_document and we automatically handle batch execution at scale. Docs here: https://lnkd.in/gCQnjF7a

Serving fine-tuned models efficiently at scale remains a key systems challenge. Learn how our AI research team built a custom inference engine that out-performs open source alternatives by up to 1.8x and delivers fewer errors on common benchmarks. This engine makes parameter efficient fine-tuning (PEFT) inference work at scale without sacrificing performance or model quality. https://lnkd.in/gxnS8Qi4

80% of enterprise data is unstructured, locked in PDFs, reports, and diagrams that traditional tools can’t parse or govern. Introducing ai_parse_document, state-of-the-art document intelligence on Databricks. With a single SQL command, teams can now turn any document into structured, queryable data,  unlocking context that agents can finally reason over — at up to 5× lower cost. • Capture every element — tables, figures, and diagrams — with AI-generated descriptions and precise bounding boxes • Process at scale with Lakeflow and govern everything in Unity Catalog • Use parsed data seamlessly across Agent Bricks, Vector Search, and AI/BI Now in Public Preview! https://lnkd.in/gQRfaqSj

Join us at #MSIgnite to explore what’s next in data, analytics, and AI with Azure Databricks! See how teams are building smarter with: - Serverless workspaces and agentic AI using Lakebase and Agent Bricks - Unified SAP and Azure data for advanced analytics - Integrated BI and AI across Power BI, Copilot, and Azure AI Foundry Visit Booth 5410R or join our sessions to see how Databricks and Microsoft are helping enterprises turn data into intelligence. https://lnkd.in/gBHN9uAS

Converting from external to managed tables in Unity Catalog is now easier and faster. Teams can migrate with minimal downtime while preserving configurations, table history, and control over where data is stored. Unity Catalog managed tables deliver major benefits — up to 20x faster queries, 50%+ lower storage costs, and stronger governance with fine-grained access controls and full data lineage. Learn how to plan your conversion, manage rollbacks, and keep control over your data’s physical storage location: https://lnkd.in/guDqWKK2

Submissions are now open for the Databricks Free Edition Hackathon! Build something incredible with Free Edition and show what’s possible with data and AI. Whether it’s an AI agent, a machine learning model, or a powerful visualization, this is your opportunity to share your project with the global data + AI community. Projects will be judged by Databricks leaders Reynold Xin, Franco Patano, Holly Smith, and William Valori. Submit your project by November 14: https://lnkd.in/gNiy4eVV

Join Databricks Co-founder and CEO Ali Ghodsi and OpenAI Co-founder and CEO Sam Altman for an exclusive conversation on building AI agents that deliver real results. Learn how to: - Tailor AI agents to your business goals - Build, train, deploy and continuously improve them faster with Agent Bricks - Monitor performance continuously and at scale - Control cost while maintaining quality Discover how Databricks and OpenAI are helping organizations bring AI agents to production faster and elevate the standard for enterprise AI quality https://lnkd.in/gtB37jWS

AI adoption is booming, with 72% of workers now using it in their day-to-day work. The next opportunity? Building AI agents for automating repetitive tasks and speeding up tasks that require deep research. With only 13% of teams having integrated agents into their workflows so far, we've launched two new courses to help you take the next step: AI Agent Fundamentals and Get Started with AI Agents. Learn to design, build, and deploy production-ready agents on Databricks, and earn a badge to showcase your skills: https://lnkd.in/gDYCujW3

Databricks Free Edition is a no-cost environment to explore, experiment, and build with data and AI. Databricks Solutions Architect Youssef Mrini shows how to ingest data, build dashboards, and train AI models on the same unified platform used by millions of data and AI professionals. See how to get started building and sharing with the global community. https://lnkd.in/gZ3vmv6p

Legacy BI tools come with a ton of hidden costs: performance issues, expensive usage, and ultimately strategic risks to decision-making. Databricks AI/BI democratizes data-driven decisions with natural language. We migrated 1,300+ dashboards to AI/BI in just 5 months, and achieved: • 5x faster performance • $880K annual cost savings • 80% higher user satisfaction Explore the migration playbook that made it possible: https://lnkd.in/gFK6rHXT