CDPCommunity.org - Snowpipe

Snowflake-powered donor data platform with automated ingestion and secure, multi-tenant architecture

As Snowflake SELECT Partners, TaylorMade Software was engaged by CDPCommunity.org—a nonprofit supporting ~100 other nonprofits—to architect a secure and scalable Snowflake data platform. Their donor and donation data (~5 GB/month) needed to be reliably ingested and isolated per client while supporting advanced analytics and future identity integration.

We designed a cost-effective, multi-tenant Snowflake data lake. Using Snowflake external stages and S3-triggered Snowpipes via AWS Lambda, we fully automated ingestion of donor files into Snowflake tables. Our solution incorporated Snowflake RBAC for client-level data isolation and BI integration for campaign effectiveness reporting.

To replace their manual, error-prone file upload process, we assessed SFTP alternatives to Cyberduck and recommended Files.com and GoAnywhere for secure, browser-based uploads with native S3 backends and multi-IdP SSO support. This paved the way for MFA and federated identity enhancements using AADS and Okta.

We also evaluated Iterable's identity constraints and scoped two feasible paths for multi-IdP support, including the use of a federated IdP broker and dedicated tenant segmentation. These recommendations provide a long-term roadmap for enterprise-grade identity alignment across platforms.

The result: CDPCommunity.org now relies on Snowflake as a centralized, automated, and secure data lake—cutting operational workload by over 60%, improving ingestion reliability, and setting the foundation for scalable, donor-driven marketing analytics.