Please note this event has been rescheduled for April 16 at 9 am PT! Your registration will automatically update and send an updated calendar invitation. Registration will be open for 2 more weeks! Are you ready for another BrickTalk? Finance fri...
Turn AI hype into everyday business decisions Join us for the Databricks Learning Festival – Business Edition, a free, global virtual event designed specifically for business professionals looking to unlock the power of data and AI — no deep technica...
Earlier this week, Databricks shared a deep dive into Lakebase Postgres database branching, a “Git‑style” way to work with your databases, meaning you can now create instant, isolated Postgres environments in seconds, without copying all the data or ...
Software development is shifting from a slow, linear process to a rapid, evolutionary one driven by AI agents. Instead of building a single application over time, developers and agents now generate, test, and iterate on multiple versions in parallel...
Databases have powered software for decades, but their underlying architecture hasn’t kept pace with modern application needs—especially in the era of AI and rapid development. Lakebase introduces a new approach by separating compute from storage an...
Developers want to write code, not provision databases. Learn how to create and deploy apps directly on the Databricks Platform. Join us on May 5-7. In this webinar, code comes first. Watch experts from Databricks and Cursor demonstrate how to get ...
95% of AI agents fail production – Agent Bricks fixes Accuracy, Flexibility & Security gaps with auto-tuning benchmarks, secure data connections, and built-in governance. The Proof is in Production:Banks save 200K hours/$250M, energy cuts outages 25%...
We are back with instructor-led Databricks Learning Festivals for APAC & EMEA! Both Udemy and LinkedIn recognized Databricks as one of the top fastest growing skills for 2026 — Udemy's The 100 Fastest-Growing Global Skills for 2026 and LinkedIn's T...
June 15–18, 2026 Register Now! Join thousands of data analytics and AI professionals at Data+ AI Summit 2026, the world’s largest conference for data, analytics and AI in San Francisco and virtually. Don’t miss early-bird pricing! Early-bird discoun...
Customer lifetime value (CLV) tells you which customers are truly worth the most over time, but turning raw transaction data into future‑value signals is hard at scale. With this Databricks accelerator, you can quickly model CLV and start targeting h...
The Weekly Digest • April 06 – 12 Community Pulse The top minds, the deepest dives, and the latest news keeping the community buzzing. Spotlight Contributors The members keeping the ecosystem moving this week: @szymon_dybczak @Sumit_7 @bala...
Serverless compute now powers Notebooks, Lakeflow Jobs, and Spark Declarative Pipelines (SDP) on Databricks, taking care of infrastructure so data teams can focus on building and running workloads instead of managing clusters. Key highlights No clust...
Based on the documentation, the Agents option should appear in the left sidebar under the AI/ML section. I don't see it, is because the region? I'm in us-east-2What should I do to see it? Thank you
You can find them in the AI Playground in Free Edition.Click on Playground in AI ML menu.Open Tools: Click on the Tools button.Add Tool: Select + Add tool.Under the MCP Servers section, you will see the four core categories (Genie Spaces, Unity Catal...
Hi Databricks Community,We are looking for the recommended best practice for managing environment-specific configurations (catalogs and schemas) within our SQL files when using Databricks Asset Bundles.Our Setup:We use Databricks Asset Bundles to pac...
Hi @DineshOjha The best approach is parameterized SQL with widget-based defaults in your Python wrapper, wired to DABs target variables. Why this works on both fronts: Engineers run the notebook interactively and widget defaults kick in (dev values)....
Every organization has critical information trapped in PDFs and unstructured documents: forms, reports, records, filings. Historically, turning those files into usable data has meant manual data entry, brittle OCR scripts, or single-purpose tools th...
Is there any documentation available around the changeset size thresholds for materialized view incremental refreshes? Are these configurable at all? Are they constant or do the thresholds change depending on the number of rows/size of the material...
Hi,I have ran into a problem when creating materialized view.Here's my simple query I'm trying to run:%sql create or replace materialized view catalog.schema.mView_test as select * from catalog.schema.table limit 10;I'm getting following error:Encoun...
There are multiple requirements for materialized views. You can check belowYou must use a Unity Catalog enabled pro or serverless SQL warehouse.To incrementally refresh a materialized view from Delta tables, the source tables must have row tracking e...
HiHow do I disable Data Apps on my workspace. This is really annoying that Databricks pushes new features without any option to disable them. At least you should have some tools to control access before rolling it out. It seems you only care about fe...
I'm an account level admin and can't find any options manage creation access of Databricks Apps in the account console. Where can I limit app creation in the Account Console?
“Now, we have a clear direction and technology to support it. With open source data lakehouse, we can centralize all of our global data in one place. Adding in the benefits of a serverless infrastructure, we can now perform various AI analytics at sc...
Hi guys!I faced an issue with the permission model in Databricks.Data engineers in my team are using a Pipeline that runs on serverless compute. The permissions for the pipeline are configured correctly, for example as follows:resource "databricks_pe...
Hi,we're exploring replacing one of the use cases we are running in our clour provider with a Databricks pipelines. We currently have explored possibility to subscribe to an eventhub using SDP pipelines, feedding our iot data into a Delta table where...
Dear all,Appreciate if anyone can provide the document/source related to Naming convention that can be followed within Databricks. Regards,Aijaz
Hi @miraijaz , Databricks doesn’t enforce a single enterprise-wide naming standard, but there are a few official/public guidelines you can lean on. See the "Names" section of the SQL language reference.This covers allowed characters, length limits, a...
Establishing a trusted Continuous Integration/Continuous Deployment (CI/CD) process is crucial for effectively managing the lifecycle of your data and AI workloads in Azure Databricks. However, with numerous setup options and a constantly evolving pl...
I received a certification voucher that must be used before May 2nd, 2026. I am scheduled to take the exam on-site in my country, but nationwide internet degradation and slow speeds are expected to last for several weeks, as announced in the news.My ...
Hello @rababid Please file a ticket with our support team and allow the support team 24-48 hours for a resolution. Please note that we cannot provide support via community. Thanks & Regards,@cert-ops
We are implementing an incremental load for semi-structured data [ complex nested Json file ]using Auto Loader. To handle schema drifts—such as new fields, changes in column order, or data type and precision modifications (e.g., Decimal and Integer)—...
Could you please help us with this? We are currently blocked in development. When new fields are added to the source JSON, the nested field names are captured in the _rescued_data (rescue) column. However, we do not get any indication of the type of ...
We are extracting data from SQL Server/Oracle using ADF and storing it in Parquet format. When reading the files in Databricks using spark.read.parquet, decimal values are getting truncated—for example, 1245.1111111189979 becomes 1245.111111118. This...
| User | Count |
|---|---|
| 2256 | |
| 1311 | |
| 1192 | |
| 1177 | |
| 957 |
| User | Count |
|---|---|
| 411 | |
| 286 | |
| 220 | |
| 63 | |
| 49 |
Every organization has critical information trapped in PDFs and unstructured documents: forms, reports, records, filings. Historically, turning those files into usable data has meant manual data entr...
Establishing a trusted Continuous Integration/Continuous Deployment (CI/CD) process is crucial for effectively managing the lifecycle of your data and AI workloads in Azure Databricks. However, with n...
If you work in infrastructure or data engineering, there is a good chance syslog-ng is already somewhere in your stack. It is one of the most widely deployed open source log management tools in the wo...
Every system you run generates a constant stream of signals: traces that show how a request travelled through your service, logs that capture what happened and why, and metrics that measure the overal...
