#dataengineering

135 posts

@gun_io Data Engineer Job Description Template (Copy and Paste) + What to Pay #DataEngineering #Hiring #TechJobs
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/gun_io/posts/22380394
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/gun_io/posts/22380394
Don't have an account? Find a server at joinmastodon.org
Sep 24, 2026
@lobsters Adaptive Lossless Floating-Point Encoding in Apache Parquet #DataEngineering #OpenSource #Databases
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/lobsters/posts/22342664
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/lobsters/posts/22342664
Don't have an account? Find a server at joinmastodon.org
Sep 23, 2026
@airbnb_engineering The guest journey, updated in real time: extending Airbnb's sequence recommender with Chronon #MachineLearning #DataEngineering #RealTime
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/airbnb_engineering/posts/22335197
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/airbnb_engineering/posts/22335197
Don't have an account? Find a server at joinmastodon.org
Sep 17, 2026
@clickhouse_blog The official ClickHouse provider for Apache Airflow is now available #DataEngineering #Analytics #OpenSource
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/clickhouse_blog/posts/22411048
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/clickhouse_blog/posts/22411048
Don't have an account? Find a server at joinmastodon.org
Sep 17, 2026
@lets_encrypt How We Built a Data Warehouse Using ClickHouse #DataEngineering #Cloud #Tech
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/lets_encrypt/posts/22369524
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/lets_encrypt/posts/22369524
Don't have an account? Find a server at joinmastodon.org
Sep 17, 2026
@lobsters Absolutely Everything You Always Wanted to Know About Watermarks in Apache Flink #Tech #DataEngineering #ApacheFlink
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/lobsters/posts/22324494
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/lobsters/posts/22324494
Don't have an account? Find a server at joinmastodon.org
Sep 10, 2026
@clickhouse_blog Loading Parquet data into MySQL with ClickHouse #ClickHouse #Database #DataEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/clickhouse_blog/posts/22411119
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/clickhouse_blog/posts/22411119
Don't have an account? Find a server at joinmastodon.org
Sep 10, 2026
@data_methods Overview of Modern Data Systems #DataEngineering #DataArchitecture #Analytics
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/data_methods/posts/22413945
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/data_methods/posts/22413945
Don't have an account? Find a server at joinmastodon.org
Sep 4, 2026
@hackernews Fast drilldown dashboards from a single Parquet file #HackerNews #Tech #DataEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22304495
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22304495
Don't have an account? Find a server at joinmastodon.org
Aug 24, 2026
@netflix_tech A Tale of Two Flink Autoscalers #Tech #DistributedSystems #DataEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/netflix_tech/posts/22302293
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/netflix_tech/posts/22302293
Don't have an account? Find a server at joinmastodon.org
Aug 21, 2026
@datadog_blog Data pipeline monitoring 101: Tracking health and performance across the data stack #DataEngineering #Observability #CloudComputing
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/datadog_blog/posts/22377071
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/datadog_blog/posts/22377071
Don't have an account? Find a server at joinmastodon.org
Aug 14, 2026
@redis_blog Fresh context: change data capture, not batch ETL #Database #DataEngineering #Tech
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/redis_blog/posts/22453254
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/redis_blog/posts/22453254
Don't have an account? Find a server at joinmastodon.org
Aug 12, 2026
@clickhouse_blog How Physical Intelligence unified its robotics data stack with Postgres managed by ClickHouse #DataEngineering #CloudDatabase #Analytics
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/clickhouse_blog/posts/22411492
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/clickhouse_blog/posts/22411492
Don't have an account? Find a server at joinmastodon.org
Aug 6, 2026
@hackernews Indexing the Data Lake for Online Point Queries #HackerNews #Tech #DataEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22278911
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22278911
Don't have an account? Find a server at joinmastodon.org
Aug 1, 2026
@spotify_engineering Indexing the Data Lake for Online Point Queries #DataEngineering #BigData #CloudComputing
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/spotify_engineering/posts/22273438
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/spotify_engineering/posts/22273438
Don't have an account? Find a server at joinmastodon.org
Jul 27, 2026
@data_methods Why I Decided to Give dbt Another Look #DataEngineering #SQL #Analytics
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/data_methods/posts/22413974
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/data_methods/posts/22413974
Don't have an account? Find a server at joinmastodon.org
Jul 27, 2026
@lobsters A Fast Path for Fixed-Length Lists in Parquet #DataEngineering #Performance #Parquet
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/lobsters/posts/22272775
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/lobsters/posts/22272775
Don't have an account? Find a server at joinmastodon.org
Jul 27, 2026
@clickhouse_blog Migrate Datadog telemetry with the OpenTelemetry Collector #DataEngineering #OpenTelemetry #Databases
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/clickhouse_blog/posts/22411678
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/clickhouse_blog/posts/22411678
Don't have an account? Find a server at joinmastodon.org
Jul 21, 2026
@definite_blog What Replaces What: Mapping Your Cloud Data Stack to One Self-Hosted Platform #DataEngineering #CloudData #Analytics
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414795
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414795
Don't have an account? Find a server at joinmastodon.org
Jul 6, 2026
@definite_blog Understanding MotherDuck Pricing: Ducklings, Cooldown, and AI Units #DataEngineering #Cloud #Analytics
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414790
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414790
Don't have an account? Find a server at joinmastodon.org
Jul 6, 2026
@definite_blog Migrating Off Snowflake: A Step-by-Step Guide #DataEngineering #CloudComputing #DataMigration
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414781
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414781
Don't have an account? Find a server at joinmastodon.org
Jul 6, 2026
@definite_blog Databricks Alternatives for Teams That Don't Need Spark (2026) #DataEngineering #Analytics #Cloud
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414767
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414767
Don't have an account? Find a server at joinmastodon.org
Jul 6, 2026
@definite_blog Cloudera Alternatives: Full-Stack Self-Hosted Data Platforms Without the Hadoop Baggage #DataEngineering #CloudData #Analytics
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414760
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414760
Don't have an account? Find a server at joinmastodon.org
Jul 6, 2026
@datadog_blog How we measure data completeness at scale #Observability #DataEngineering #Cloud
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/datadog_blog/posts/22377357
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/datadog_blog/posts/22377357
Don't have an account? Find a server at joinmastodon.org
Jul 1, 2026
@data_methods How Debezium Works #DataEngineering #Databases #SQL
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/data_methods/posts/22414000
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/data_methods/posts/22414000
Don't have an account? Find a server at joinmastodon.org
Jun 30, 2026
@definite_blog Metabase AI: What It Does, Where It Stops, and What the Ceiling Is #DataEngineering #Analytics #AI
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414827
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/definite_blog/posts/22414827
Don't have an account? Find a server at joinmastodon.org
Jun 22, 2026
@netflix_tech The Data Canary: How Netflix Validates Catalog Metadata #DataEngineering #Reliability #Automation
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/netflix_tech/posts/22291070
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/netflix_tech/posts/22291070
Don't have an account? Find a server at joinmastodon.org
Jun 19, 2026
@netflix_tech Data Projects: Managing Data Assets at Netflix Scale #DataEngineering #BigData #Tech
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/netflix_tech/posts/22291079
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/netflix_tech/posts/22291079
Don't have an account? Find a server at joinmastodon.org
Jun 19, 2026
@hackernews Databricks Launches LTAP: A Unified OLAP/OLTP Data Architecture #HackerNews #Tech #DataEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22230803
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22230803
Don't have an account? Find a server at joinmastodon.org
Jun 16, 2026
@data_methods Data System Modernization Playbook For AI Readiness #DataEngineering #AI #Cloud
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/data_methods/posts/22414008
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/data_methods/posts/22414008
Don't have an account? Find a server at joinmastodon.org
Jun 11, 2026
@airbnb_engineering Scaling beyond one: How Airbnb evolved its data architecture for a multi-product world #DataEngineering #Tech #Architecture
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/airbnb_engineering/posts/22293346
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/airbnb_engineering/posts/22293346
Don't have an account? Find a server at joinmastodon.org
Jun 9, 2026
@artem_golubin NULLs in ClickHouse can hurt performance #Database #Performance #DataEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/artem_golubin/posts/22454539
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/artem_golubin/posts/22454539
Don't have an account? Find a server at joinmastodon.org
Jun 3, 2026
@nic_crane Introduction to Parquet #DataEngineering #OpenSource #BigData
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/nic_crane/posts/22442020
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/nic_crane/posts/22442020
Don't have an account? Find a server at joinmastodon.org
Jun 1, 2026
@hackernews Show HN: Streambed - Stream Postgres to Iceberg on S3, Supports Postgres Wire #HackerNews #Tech #DataEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22212942
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22212942
Don't have an account? Find a server at joinmastodon.org
May 31, 2026
@hackernews Made a Tool to Streams Changes from Microsoft SQL Server to Apache Kafka #HackerNews #Tech #DataEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22215295
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22215295
Don't have an account? Find a server at joinmastodon.org
May 31, 2026
@hackernews Building a LangGraph pipeline for production data engineering #HackerNews #Tech #DataEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22212524
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22212524
Don't have an account? Find a server at joinmastodon.org
May 31, 2026
@google_open_source_blog Announcing Apache Iceberg 1.11.0 #OpenSource #BigData #DataEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/google_open_source_blog/posts/22372950
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/google_open_source_blog/posts/22372950
Don't have an account? Find a server at joinmastodon.org
May 27, 2026
@airbnb_engineering Scaling Airbnb's identity graph with a unified knowledge graph infrastructure #DataEngineering #KnowledgeGraph #Tech
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/airbnb_engineering/posts/22293380
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/airbnb_engineering/posts/22293380
Don't have an account? Find a server at joinmastodon.org
May 19, 2026
@airbnb_engineering Viaduct 1.0 and the future of Airbnb's data mesh #DataEngineering #OpenSource #Tech
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/airbnb_engineering/posts/22293389
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/airbnb_engineering/posts/22293389
Don't have an account? Find a server at joinmastodon.org
May 13, 2026
@hackernews Snowflake Postgres, Lakebase, HorizonDB: Picking the Lock-In You Want #HackerNews #Tech #DataEngineering
Boost from your server
Enter the server your account is on. The post opens there so you can boost it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22192911
Don't have an account? Find a server at joinmastodon.org
Favorite from your server
Enter the server your account is on. The post opens there so you can favorite it.
Your server
or
Or paste this post's address into your app's search:https://robot.villas/users/hackernews/posts/22192911
Don't have an account? Find a server at joinmastodon.org
May 12, 2026

« Newer Older »