Latest
Data Observability

Apache Spark 4 | Comparison with previous version

Discover the core differences between Apache Spark 4.0 and Spark 3.x, including performance improvements, columnar execution, streaming upgrades, and Python UDF enhancements.

by

Jatin

Updated on

June 4, 2025

Other blog articles

Training Language Models with Enterprise Data: Benefits and Considerations

Explore the advantages and key considerations of training language models with enterprise data, including security, customization, scalability, and cost.

By

Melanie

Updated on

August 3, 2024

Pipeline Observability

New connector: Azure Data Factory

Integrate Azure Data Factory with Decube’s Data Catalog. Monitor job statuses, investigate incidents, and visualize data lineage efficiently.

By

Melanie Yong

Updated on

August 3, 2024

Data Observability

Data Lake: Overview, Architecture, and Key Concepts

Explore the architecture of data lakes and learn their benefits in storing and analyzing diverse data types

By

Jatin Solanki

Updated on

August 3, 2024

Importance of Embedding in AI / Generative AI

Discover the transformative role of embeddings in GenAI, revolutionizing data processing for enhanced efficiency and interpretability.

By

Melanie Yong

Updated on

June 15, 2024

New: Group-Based Access Control and Approval Workflow

Discover Decube's new Group-Based Access Control and Approval Workflow. Manage user permissions and streamline access with enhanced features.

By

Melanie Yong

Updated on

August 3, 2024

Migrating from Apache Airflow to Dagster

Guide to migrating from Apache Airflow to Dagster, covering pros, cons, data quality checks, lineage, and learning curve.

By

Jatin Solanki

Updated on

August 3, 2024

Data Observability

New Connector: Azure Synapse Analytics

Discover how the integration between Azure Synapse Analytics and Decube brings advanced data monitoring, in-depth insights and robust data governance. Get connected today and unlock a new level of data visibility, control, and insights.

By

Melanie Yong

Updated on

June 17, 2024

What is ACID transactions?

Learn about ACID transactions—Atomicity, Consistency, Isolation, and Durability—ensuring reliable and secure data management in database systems.

By

Jatin Solanki

Updated on

August 3, 2024

What is MLOps?

Explore MLOps, blending Machine Learning with DevOps to streamline model development, deployment, and maintenance for scalable, efficient AI capabilities.

By

Jatin Solanki

Updated on

October 2, 2024

Batch vs Streaming: Data Processing Comparison

Explore the distinctions between batch and streaming data processing, uncovering their strengths, weaknesses, and ideal applications

By

Jatin Solanki

Updated on

May 12, 2024

Understanding Data Fabric & it's Definition, Architecture, Need

Explore data fabric: a comprehensive guide to its definition, architecture, and how it integrates diverse data environments.

By

Jatin Solanki

Updated on

July 30, 2024

Ingest Data to Vector Database: Milvus Example

Learn how to ingest data from AWS S3 into Milvus. Includes handling diverse data types and Python code examples for efficient similarity search

By

Jatin Solanki

Updated on

October 2, 2024

Vector Databases Explained: Key Features, AI Integration, and Use Cases

Discover how vector databases are transforming AI and machine learning by storing and querying high-dimensional data vectors. Learn about key features like vector indexing, scalability, and real-world use cases in recommendation systems, search engines, and more with Decube.

By

Jatin Solanki

Updated on

October 7, 2024

Data Observability

Data Quality Metrics for Data Warehouse

Explore key data quality metrics for data warehouse integrity and improved decision-making.

By

Jatin Solanki

Updated on

August 3, 2024

Data Observability

Data Freshness: What is it? Definition, Importance & Applications

Learn about data freshness: its definition, importance in decision-making, and applications across various industries.

By

Jatin Solanki

Updated on

June 15, 2024

New: Data Recon UI and Preview Sample Data

Data Recon gets a new look, and we've added the ability to preview sample data directly within decube. Check it out here.

By

Melanie Yong

Updated on

January 10, 2024

Implementing Data contracts in the Data Warehouse

In the realm of warehousing, data contracts play a crucial role in establishing clear guidelines for data management and sharing. These contracts outline data ownership, usage rights, security measures, and compliance requirements, ensuring transparency and trust between stakeholders. Effective data contracts foster efficient operations and facilitate meaningful collaborations within the warehouse ecosystem.

By

Jatin Solanki

Updated on

January 10, 2024

Data Profiling: Process, Best Practices and Tools

Discover the importance of data profiling in analysis, ensuring data quality, integrity, and optimal management for informed decision-making

By

Jatin Solanki

Updated on

June 15, 2024

Grow with our latest insights

Sneak peek from the data world.

Thank you! Your submission has been received!
Talk to a designer

All in one place

Comprehensive and centralized solution for data governance, and observability.

Get Started
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Request a demo
Explore Sandbox
decube all in one image