Given an async iterable object that supports the for await...of statement, what is the most efficient way to write the elements into an IPC Streaming format file from Apache Arrow?
Elements are objects following the same schema which contains different data types, for example:
[
{
id: '747368456',
product: 'foo',
price: 732.98,
created: '2021-05-01T14:00:33.048Z',
},
{
id: '747368457',
product: 'foo2',
price: 2.98,
created: '2021-05-01T14:10:33.023Z',
}
]
Is it possible to do it asynchronously and without waiting for all the JSON objects?