Oh my gourd, it’s Oct already! Let’s talk about all the highlights of the past month we hope you fall for.
Meltano brings the benefits of open source and DevOps best practices to the data lifecycle by embracing DataOps. Join the community to learn more.
Releases
The team has been busy this past month working on improvements across Meltano and building the community. Check out the changelog for all of the details and take a look at highlights from V1.80 - V1.83, including:
#2927 local Kubernetes deployment
#2609 Add Meltano config <plugin> test command to test an extractor plugin's configuration. Learn more here: Testability now available for all taps in the Singer ecosystem
#2647 Extend Meltano select with flag to remove rules.
#2782 Switches all extractors and loaders in discovery.yml to variants syntax
#2950 Update werkzeug to 2.0.
SDK Releases
#160 Set key_properties = [] instead of null per the Singer spec.
#164 Add description attribute to Property class for JSON schemas.
!173 Tap and Target SDK: Prevents the leaking of sensitive configuration values when JSON schema validation fails
Visit the changelog for more details
Hub Releases
tap-airtable maintained by the folks at y42
Thanks to ...@Charles Julian Knight, @Reuben (Matatika), @Kevin Mullins, @Keith Siilats, @Niall Woodward, @Stephen Bailey (Immuta), Maarten van Gijssel, Laurent Savaëte, @Fran Lozano, @David Wallace, @Adam Roderick, @David Ladd!
To see what’s coming up next, take a look at our roadmap.
Hot takes with Data Bae
all tools your organization buys are basically trying to enforce operational discipline in one way or another.
and most of them are just making sure you don't put shitty data into a database.
Community crushing it
The Meltano community is a passionate bunch, and we’re so lucky to collaborate with them. Here are a few of our favorite moments from September.
Singer Spec Working Group - A new group dedicated to promoting the Singer protocol, pooling our respective resources to help meet the needs of the broader Singer community.
GitHub Project with Issue Tracker - Feel free to add new issues for topics, and comment on existing ones
Planned topics for the working group include:
Discuss the expansion of Singer capabilities, including spec extensions
Understand "feature gaps" in terms of Singer coverage and capabilities
Create a shared taxonomy of Singer features and capabilities
Continually improve dev resources such as the SDK and How-To documentation
Anything else that is relevant to the continued success of Singer and the Singer community
The future is bright for open source data tooling
Last week, we co-hosted the first-ever Open Source Data Stack Event, with our partners at Dagster, dbt Labs, Grouparoo, Preset, Snowplow. Our very own Taylor Murphy, Head of Data and Product, spoke on Community Driven, Open Source Data Integration.
Check out recordings of all the talks.
Highlights from Office Hours and Demo Day!
Each month, we invite the community to build Meltano with us through Office Hours and Demo Day.
During this month’s Office Hours, we got to chat about deploying with Terraform, Helm, and Kubernetes. Ken Payne walked us through his thoughts on this -- deploying and scaling are top of mind.
We also invited you to talk to us about how we collect anonymous usage statistics.
Well said…
Needless to say, we are Stanning over all of Benn Stancil’s newsletter posts.
In the news
Culture and company building
Meet Melty Meltano the Dragon, our new mascot
Hiring
Welcome to the team Pat! We’re excited to work with Pat who joins as Senior Data Engineer.
We are opening up 7 extra roles before the end of the year. Check out our open roles!
Upcoming
Want to learn more about the Meltano vision? Hear what we have upcoming:
Mission, vision, and strategy updates
Tap-toberfest - another Wiesn to tap
Join us at office hours every Wednesday at 9 AM Pacific
Demo Day kicks off every other week on Thurs 9 AM Pacific