Hello!
I've been looking at the user export API endpoint and wondering what will happen if I try to export millions of users?
There is no paging option, I could end up in a situation where the server keeps timing out and I am unable to export all the users, as I can't do it bit by bit either.
curl -H "Api-Key: ${ITERABLE_KEY}" 'https://api.iterable.com/api/export/data.json?dataTypeName=user&range=All&onlyFields=email'
Any workarounds or ideas would be much appreciated.
Ed
Hi Ed,
Thank you for reaching out, I am happy to help!
There is no data size limit on exports however, the larger the data is, the slower the export is and the more risk of the call timing out. Instead of using "all" as the range, I recommend using the start and end date time fields and making several calls versus just one. It is important to note that the api/export/data.json endpoint has a rate limit of 4 requests per minute, which means you can submit that call only once per 15-second interval.
Thank you,
Alejandra
Thanks Alejandra Perez
It's still not great, Iterable should consider implementing paging on that endpoint as that would make for a better UX during integrations
Reply
Create a new Iterable Plaza community account
Already have an account? Login
Login to the Iterable Plaza Community
Not a customer? Create an account
Log in to Iterable (SSO)
Iterable customers and employees login/create an accountEnter your E-mail address. We'll send you an e-mail with instructions to reset your password.