Our Holiday Wish List and Data Musings from November
Best of DataOps recap for November with Meltano
The only thing dropping faster than leaves this fall was all the data news. There seem to be more and more rumblings that team and data professionals need a more functional and collaborative data experience. There need to be shortcuts and ways to standardize common interactions with data. But how do we get there? We have a proposed solution. Check out the latest on how we are building the DataOps OS.
Enough about our grand vision for the future of a modern data stack. Let’s talk about highlights from November.
Releases
Meltano (v1.87.0 to v1.88.0)
The team has been busy this past month working on improvements across Meltano and building the community. Check out the changelog for all of the details and take a look at the highlights below.
Meltano Environments - Let project plugin definitions and config be defined in multiple individual YAML files (#2456). Thanks, Matthew Thurman for the inspiration and first draft!
Multi File Support - built with the Meltano Community
Hides non-default Meltano variants from the UI (#3042)
Add matatika variant of tap-solarvista extractor (#3003).
Don’t forget to check out the release day playlist.
SDK Releases (v0.3.14)
Visit the changelog for more details
Tap SDK: New method RESTStream.validate_response for custom validation of HTTP responses (#207, !195). See an example in the docs.
Tap SDK: New method RESTStream.request_decorator for custom back-off and retry parameters (#137, !195)
MeltanoHub Releases
Taps and targets now have metrics, powered by Google Analytics anonymous tracking events, on their landing pages (#126). Including the number of executions and distinct projects using them in the last 3 months.
5 hotglue variants added to MeltanoHub. Thanks Hassan Syyid!
New Target: Target-Airtable
New Tap: Tap-Sendinblue
Updated Default Variant: Tap-Woocommerce, Tap-Mixpanel, and Tap-Klaviyo
GitHub shield.io badges added for stars, forks, and contributors.
To see what’s coming up next, take a look at our roadmap.
Community Wins
The Meltano community is a passionate bunch, and we’re so lucky to collaborate with them. Here are a few of our favorite moments from November.
We've promoted our first community contributors to "Maintainer" status on a MeltanoLabs project. Congrats to @Eric Boucher
In the news
Snowflake announced Snowpark as a new developer experience.
The Data Engineering Podcast episode’s a few months old, but we found it interesting to hear these other companies’ thoughts on DataOps. The importance of metadata came up a lot.
Reverse ETL is hot! https://techcrunch.com/2021/11/17/customer-data-hightouch.
Interesting YC thread on Data Mesh vs Data Fabric.
This Sheets + Looker connection is pretty huge.
Interesting use case: Glassdoor's use of Singer.
Preset’s take on how the modern data stack is reshaping data engineering.
Cube.dev is launching their own headless BI interface.
Hashmap on Tap - Episode #99 Building a Community Around DataOps-driven ELT with Douwe Maan, founder and CEO of Meltano.
Data Leadership Lessons - Douwe discusses Open Source Data Operations and how an open source approach to data ops is contagious.
Culture and company building
Meltano’s remote work gift guide: The Meltano team compiled a list of all our favorite things this holiday season, in case you need gift ideas for that hard to shop for person in your life.
For expenses or onboarding paperwork
Apple Watch - you get told to breathe or that you have an elevated heart rate when half your work didn’t get saved after your computer crashed. But you also get gifs on your wrist. So it’s a winning gift :)
Everyone needs a solid notebook:
Addicted to this Rote Runner Notebook because we got tired of making spreads for my bullet journal by hand.
And who doesn’t love having a notebook with stitched binding that will stay open.
The ultimate headphones
And a place to hang those headphones
We think everyone needs a solid keyboard. Here are some of the team’s top suggestions:
And a version if you want to stay in the holiday spirit
Every Keyboard needs its own 5° 60% Anodized Aluminum Case - Black.
ABS Doubleshot Keycaps Set - 104 Key - Black - Spanish (Glorious PC)
Coffee subscription so you never run out.
We are hiring!
Y’all we desperately want to make DataOps heroes. Help us in this mission or be that hero. We have an open position for a DataOps Evangelist!
Check out all of the awesome open roles.
Upcoming
We have decided the team deserves a well-earned break so we are closing our office Dec 20-Jan 3, 2022! See y’all in the new year.
Updates to the Meltano Documentation and website are coming soon!
We will be at our first ever in-person event, Data Council Austin Jan 27-28, 2022.
Save the date for next year’s first Tap-a-thon: Feb 14-24, 2022.