October was really gourd fun all around. We carved out time for our first-ever Tap-toberfest, resulting in more taps in one week than we usually get in a quarter. We hope all of the new taps come in candy, or that we gave you pumpkin to talk about with your data teams.
As always, Meltano brings the benefits of open source and DevOps best practices to the data lifecycle by embracing DataOps. Join the community to learn more.
Releases
Meltano (v1.84.0 to v1.86.0)
The team has been busy this past month working on improvements across Meltano and building the community. Check out the changelog for all of the details or take a look at these highlights:
#2357 Use dbt v0.21.0 by default for new dbt installs
2363, 2360 Small branding and logo updates throughout - and introducing Melty to the community!
#2339 Updated the elt log format to include a subtask field. Lines are now prefixed with <name> | <subtask> , which may cause issues with existing log parsers. This means the output of Discovery Mode from a tap will be included on the command line in an easy to understand manner.
#2997 Bump required version of jsonschema.
Changed the default variant for target-snowflake, tap-adwords, tap-facebook, tap-csv, and tap-gitlab
#2869 Introduce top-level “Environments” within `meltano.yml`
SDK Releases (v0.3.11 to v0.3.13)
Visit the changelog for more details
Tap and Target SDK: Adds capability to print markdown docs with --about --format=markdown (!172, !180) -- Thanks, @Nick Müller!
#249 Target SDK: CLI flag for targets to read messages from a file instead of stdin -- Thanks, @Charles Julian Knight!
#198 Target SDK: Add target mock classes and tap-to-target scenario tests
#186 Tap and Target SDK: Create expanded list of capabilities
Tap and Target SDK: Autogenerated docstrings for arguments, return types, and exceptions raised (!166).
Tap and Target SDK: Support Black by default by bumping min Python version to 3.6.2. (#224, !169)
Hub Releases
The One API now being listed on MeltanoHub
And Tap-toberfest was a wild success. We saw a huge bump in tap usage and more tap submissions in a week than we normally get in a quarter. Check out the rest of the highlights in our recap blog or see a shirt list of some submissions below.
tap-clickup
tap-openweathermap
tap-spotify
tap-thunderboard
tap-aws-cost-explorer
tap-pinterest-ads
tap-peloton
tap-stackexchange
To see what’s coming up next, take a look at our roadmap.
Hot takes with Data Bae
Community crushing it
The Meltano community is a passionate bunch, and we’re so lucky to collaborate with them. Here are a few of our favorite moments from October.
Highlights from office hours and demo day!
Each month we invite the Meltano community to build Meltano with us through Office Hours and Demo Day.
Guides
For anyone interested in the combination of Meltano and Dagster, here is an article on how to get started from Josh Lloyd.
The modern Data Experience and how it relates to DevOps from dbt Labs.
In the news
Meltano won a Bossie Most Groundbreaking Products Available to Developers and IT Organizations award!
Congrats to GitLab on their IPO. Thanks for leading the way for other open source startups to dream big.
The future of Singer is so bright we need shades...
Beyond Tap-toberfest we hosted the second Singer Working Group session. Updates on the group and its purpose can be found in the Singer Working Group Blog.
Meltano Labs Launched - your home for Singer Connectors, dbt packages, and Meltano Plugins.
Culture and company building
Meet Melty the Dragon our new mascot!
The latest on the Meltano mission and vision
Meltano will enable everyone to realize the full potential of their data. On top of that, we are building a modular open source DataOps platform to be the foundation of every team’s ideal data stack.
Hiring
Check out our awesome open roles like DataOps Evangelist!
Upcoming
Want to learn more about the Meltano vision? Hear what we have planned:
Strategy updates
Product Features to look out for:
Structured logging
Composable pipelines- we are going green :P
Stream maps
Join us at office hours every Wednesday at 9am PT
Join us on Demo Day to see what we’ve been up to or show off what you’ve done with Meltano! These are hosted every other Thursday at 9am PT.
Heads up! As of January 1, 2022 Demo Days will switch to monthly.
Here is our Ghouls Just Want to Have Fun playlist for those who want to keep this spooktacular month going. Fangs for the memories!