Customer Data Pipelines Play a Key Role in Data Privacy
- Published on
- • 6 mins read
- Written by
- Gavin Johnson
This post was originally published on RudderStack's blog.
Customer data pipelines play a critical role in the privacy of your customer data. They are one of the primary and most expansive collectors of your customers’ personally identifiable information (PII). They are also one of the most expansive sharers of customer data - with one of the primary use cases being event streaming to frequently large libraries of destination integrations.
Due to their specialized role of collecting and sharing customer data, customer data pipelines can either help ensure your data privacy or wreak havoc on it.
In this post, we’ll explain how your customer data pipeline can help improve your data privacy and how to ensure your data privacy with RudderStack.
Data Privacy vs. Data Security
To remove one common vector of confusion before we launch into this post, we want to make sure the difference between data privacy and data security is clear.
Data privacy - the focus of this post - is about what data is collected, stored, and for how long it is retained; and what customer data is shared. What customer data are you collecting and storing, and how are you using that data?
Data security is about how collected data is protected - where data is stored, who has access, whether data is encrypted, etc. How are you keeping the customer data you store safe?
Your Customer Data Pipeline can Improve Your Data Privacy
Your customer data pipeline can give you fine-grained control over what data you are sending to which tools and what data you are storing. This can help you avoid data privacy issues before they ever occur.
The three processes below are designed to help you ensure that your customer data stays private. You can implement all of them with a robust customer data pipeline tool like RudderStack.
Data masking is taking fields in your event data and obfuscating them. This is most frequently used to hide PII. Your customer data pipeline can mask your PII before it is ever sent to a destination or stored in your warehouse.
For example, if your event payload includes the following attributes...
"globalUserId": "XYJ458907432AAC", "userId": "contactUser", "userFirstName": "Rudder", "userLastName": "Stack", "userEmail": "firstname.lastname@example.org", "userSSN": "123-45-6789", "eventType": "newsletter-sign-up”
One level of data masking would remove the directly identifiable PII, like SSN and email address.
"globalUserId": "XYJ458907432AAC", "userId": "contactUser", "userFirstName": "Rudder", "userLastName": "Stack", "userEmail": "XXXXXXX@XXXXXXXXXXX.XXX", "userSSN": "XXX-XX-XXXX", "eventType": "newsletter-sign-up”
Another, more stringent level of data masking would remove all unnecessary attributes. Since most of the attributes in this payload are identifiers in one way or another, only the global identifier and event type would be unmasked.
"globalUserId": "XYJ458907432AAC", "userId": "XXXXXXXXXXX", "userFirstName": "XXXXXX", "userLastName": "XXXXX", "userEmail": "XXXXXXX@XXXXXXXXXXX.XXX", "userSSN": "XXX-XX-XXXX", "eventType": "newsletter-sign-up”
Similar to data masking, attribute removal is selectively removing attributes from your event data. Not every application you send event data to needs all of the customer data you collect in your events. Attribute removal can be used to remove PII or to remove unnecessary customer data and reduce payload.
Using the same event example, if you wanted to activate that data by having it trigger an email send in your email/marketing automation tool, you would remove the unnecessary attributes for sending an email - userId and userSSN.
"globalUserId": "XYJ458907432AAC", "userFirstName": "Rudder", "userLastName": "Stack", "userEmail": "email@example.com", "eventType": "newsletter-sign-up”
Not all of the tools you event stream to need every type of event. Event filtering is the process of removing events from an event stream based on filtering criteria. This ensures that only the events you want to activate on are ever shared with the tools that you activate in. So you don’t overshare your customer data with tools that only use a small portion of it.
Using the same event example, if you filtered to where
eventType = "newsletter-sign-up", the sample event would be included. If you filtered to where
eventType != "newsletter-sign-up", the sample event would be excluded.
RudderStack Transformations Keeps Your Customer Data Private
If you want more details about how to use RudderStack Transformations, read our step-by-step guide on adding custom Transformations.
If you want more details about how to mask PII with RudderStack Transformations, read our blog post Protect Personally Identifiable Information (PII) in Your Apps Using RudderStack.
Try RudderStack Today
Start using a smarter customer data pipeline that builds your customer data lake on your data warehouse. Use all your customer data. Answer more difficult questions. Send insights to your whole customer data stack. Sign up for RudderStack Cloud Free today.
Join our Slack to chat with our team, check out our open source repos on GitHub, subscribe to our blog, and follow us on social: Twitter, LinkedIn, dev.to, Medium, YouTube. Don't miss out on any updates. Subscribe to our blogs today!