Freddie Mac - Snowflake Snowpipe and Governance Case Study

Snowflake governance and CI/CD modernization with iData no-code pipeline, SSO security, and role-based integration on AWS

Freddie Mac engaged TaylorMade Software to enhance Snowflake architecture on AWS, combining modern governance, CI/CD, and identity integration with enterprise tools and pipelines.

As part of a multi-architect team, we led PoCs integrating Snowflake with ADFS, Ping, SailPoint, Talend, Denodo, MicroStrategy, PowerBI, and Tableau—achieving a 30% boost in processing efficiency. Our SSO and CI/CD patterns (Terraform, Python Lambdas, Glue) received high praise from UAT stakeholders.

We implemented the iData open-source no-code pipeline (formerly in AWS Marketplace, now on GitHub) to automate data ingestion and transformation through Apache Iceberg and metadata-driven workflows :contentReference[oaicite:10]{index=10}. This significantly reduced engineering overhead while supporting scalable data loading into Snowflake.

For governance, we integrated Collibra and Okera, deployed secure Snowflake features like dynamic masking and secured views, improving data protection by 25%. We also migrated AWS Lambda orchestration from Scala to Python for improved pipeline agility.

We built a serverless MERN-stack self-service portal and ELK dashboards for provisioning and monitoring. Customized Java UDFs enabled seamless Denodo-to-Snowflake context switching, enhancing RBAC compliance across virtualization layers.

Related Case Studies