They say data is the new oil, that makes classfilterdata() the new rig. Check out how Jay Goldberg pumps the Two Sigma data lake with CFEngine.
In Episode 51 special guest Jay Goldberg of Two Sigma joined the CFEngine team to discuss data-driven configuration, other examples of data driven policy ( EFL, SCL, sysops-api, CFEngine-Roadshow, and other un-named organizations), the provenance of classfiltercsv(), and the upcoming classfilterdata() function (already in nightly packages near you). He explained how Two Sigma organizes their external data making it easy for engineers to reason with and how leveraging external data democratized the ability for other engineers to leverage the power of CFEngine without having to look at or write any policy.
classfilterdata() helps filter data containers by class expression, returning only data that is relevant for the current context. This approach allows for policies to be managed with configuration files rather than being hard-coded, reducing 110 policies down to 10 for common building blocks like files, packages, and services. Jay highlighted real-world benefits, including safer changes, less code, and significantly less effort, demonstrating a 93% reduction in code and over 30 times faster execution, transforming processes that took over 60 seconds to less than 2 seconds.
Video
The video recording is available on YouTube:
At the end of every webinar, we stop the recording for a nice and relaxed, off-the-record chat with attendees. Join the next webinar to not miss this discussion.
Links
- Connect w/ Jay, Cody, Craig, Herman, or Nick
- A brief history of configuration Managing sprawl - Mark Burgess
- classfiltercsv()
- classfilterdata()
- Neil Watson
- EFL (Evolve Thinking’s free CFEngine Library)
- Bas van der Vlies
- SURF CFEngine Library (SCL)
- Martin Simons
- CFEngine-Roadshow (internal, variable based data)
- Episode 51 resources
- All Episodes
