Turn AI hype into everyday business decisions Join us for the Databricks Learning Festival – Business Edition, a free, global virtual event designed specifically for business professionals looking to unlock the power of data and AI — no deep technica...
Our Community Champion Program has always been about recognizing individuals who consistently show up to support others, share their expertise, and strengthen the Databricks Community. Alongside our customers, we’re equally proud of the incredible co...
Earlier this week, Databricks shared a deep dive into Lakebase Postgres database branching, a “Git‑style” way to work with your databases, meaning you can now create instant, isolated Postgres environments in seconds, without copying all the data or ...
Software development is shifting from a slow, linear process to a rapid, evolutionary one driven by AI agents. Instead of building a single application over time, developers and agents now generate, test, and iterate on multiple versions in parallel...
Databases have powered software for decades, but their underlying architecture hasn’t kept pace with modern application needs—especially in the era of AI and rapid development. Lakebase introduces a new approach by separating compute from storage an...
Developers want to write code, not provision databases. Learn how to create and deploy apps directly on the Databricks Platform. Join us on May 5-7. In this webinar, code comes first. Watch experts from Databricks and Cursor demonstrate how to get ...
95% of AI agents fail production – Agent Bricks fixes Accuracy, Flexibility & Security gaps with auto-tuning benchmarks, secure data connections, and built-in governance. The Proof is in Production:Banks save 200K hours/$250M, energy cuts outages 25%...
We are back with instructor-led Databricks Learning Festivals for APAC & EMEA! Both Udemy and LinkedIn recognized Databricks as one of the top fastest growing skills for 2026 — Udemy's The 100 Fastest-Growing Global Skills for 2026 and LinkedIn's T...
June 15–18, 2026 Register Now! Join thousands of data analytics and AI professionals at Data+ AI Summit 2026, the world’s largest conference for data, analytics and AI in San Francisco and virtually. Don’t miss early-bird pricing! Early-bird discoun...
Customer lifetime value (CLV) tells you which customers are truly worth the most over time, but turning raw transaction data into future‑value signals is hard at scale. With this Databricks accelerator, you can quickly model CLV and start targeting h...
The Weekly Digest • April 06 – 12 Community Pulse The top minds, the deepest dives, and the latest news keeping the community buzzing. Spotlight Contributors The members keeping the ecosystem moving this week: @szymon_dybczak @Sumit_7 @bala...
As a data engineer, I've been watching Genie Code closely since it went GA last month, and I wanted to share some honest thoughts here today not a feature dump, but how it's starting to change the way I think about my own role.Databricks recently sha...
Our Community Champion Program has always been about recognizing individuals who consistently show up to support others, share their expertise, and strengthen the Databricks Community. Alongside our customers, we’re equally proud of the incredible co...
Congratulations, Ashwin Varadharajan. Keep contributing!
Hi @Ashwin_DSA Thanks for the response I was thinking if the results are precomputed using cube and persisted using mv that would be retrieve results faster than metric view. Could u please let me know if my understanding is correct
Dear Databricks Certification Team,I am writing regarding my scheduled exam:Assessment Name: Databricks Certified Data Engineer ProfessionalDate: 18 April 2026Time: 14:00Duration: 120 minutesI was present and ready at the scheduled time; however, I w...
@jyothi_hari Better to raise a support ticket with the team here - https://help.databricks.com/s/contact-us
Practice makes perfect, and our online Databricks-Certified-Data-Engineer-Associate practice mode is designed to replicate the actual test environment. With timed sessions, you'll experience the pressure of the real exam and become more confident in ...
@pass4surehub Good job. Though I would still suggest to choose the Learning Path over any material.
Hi everyone,I am seeing an unexpected behavior with Auto Loader when using Managed File Events on Classic Compute.The error message itself seems inconsistent with the behavior I am seeing:[FAILED_READ_FILE.DBR_FILE_NOT_EXIST] Error while reading file...
Just sharing a solution in case anyone runs into the same issue.The error was caused by the cluster configuration including spark.master: "local[*]". After removing this setting, the error stopped occurring and the Auto Loader finished correctly.This...
Today's digital learning environment depends on Learning Management Systems as crucial components. The system facilitates effective knowledge distribution while educational institutions use it to organize learning activities. LMS platforms will conti...
Has anyone else run into a situation where a breaking schema change on a SQL Server source table leaves their Lakeflow Connect pipeline in a state it can't recover from — even after destroying and recreating the pipeline?Here's what happened to us:- ...
Hi @lrm_data yes, this one catches a lot of people. A few things to check on the SQL Server side that commonly block recovery even after destroy + recreate:Stale lakeflow_* capture instance. SQL Server allows only 2 capture instances per table. If bo...
We need to import large amount of Jira data into Databricks, and should import only the delta changes. What's the best approach to do so? Using the Fivetran Jira connector or develop our own Python scripts/pipeline code? Thanks.
Hi @greengil good question, I went through this something similar recently, so sharing what I found.My instinct was also to build it in Python, but once I dug in, the "just write a script" path hides a lot of pain:Deletions are invisible. Jira's RES...
We are an education-based company currently developing a course on Databricks, which we plan to publish on platforms such as YouTube and Udemy for educational purposes.We would like to confirm whether any formal permission is required from Databricks...
Hi @Simranpreet No formal permission is required to create and sell/publish an independent educational course about Databricks, but there are specific rules you must follow regarding trademarks, logos, and official Databricks course materials.here's ...
I have a Databricks workspace on AWS (serverless compute). I created a network policy with "Allow access to all destinations" enabled and attached it to my workspace. When I run a Python notebook and try to make an HTTP request or curl to any externa...
Most likely the egress policy change hasn’t actually taken effect on the serverless compute that’s running your notebook. Check these things in order: Verify the network policy itself (Account Console → Security → Networking → Context-based ingress ...
I’m planning to take the Databricks Data Engineer Associate certification and wanted to check if there are any official discounts, student offers, or promotional coupons available to reduce the exam fee.As managing certification costs is important fo...
You can subscribe to or check the upcoming learning events here
Please note this event has been rescheduled for April 16 at 9 am PT! Your registration will automatically update and send an updated calendar invitation. Registration will be open for 2 more weeks! Are you ready for another BrickTalk? Finance fri...
If anyone wants to check out the recording you can watch it here!
Transform commercial real estate portfolio management using Databricks AI.
Hey All!We are trying out the Beta connector for SharePoint and found that the connector will not work at the root-level site. Is there a reason for this limitation. It is unfortunately a hard blocker for us to use the native connector. MUST_START...
| User | Count |
|---|---|
| 2256 | |
| 1312 | |
| 1192 | |
| 1177 | |
| 957 |
| User | Count |
|---|---|
| 411 | |
| 286 | |
| 220 | |
| 63 | |
| 49 |
Every organization has critical information trapped in PDFs and unstructured documents: forms, reports, records, filings. Historically, turning those files into usable data has meant manual data entr...
Establishing a trusted Continuous Integration/Continuous Deployment (CI/CD) process is crucial for effectively managing the lifecycle of your data and AI workloads in Azure Databricks. However, with n...
If you work in infrastructure or data engineering, there is a good chance syslog-ng is already somewhere in your stack. It is one of the most widely deployed open source log management tools in the wo...
Every system you run generates a constant stream of signals: traces that show how a request travelled through your service, logs that capture what happened and why, and metrics that measure the overal...
