I am currently thinking about using your data as a source for a data warehouse sample project. Therefore I would like to extract data on a daily basis. I would try to filter/aggregate the data to get flight information first (Start and Target airport). Starting with two common airport coordinates using lat, long and something like 0 < altitude < 20.
Would this be stupid as the resulting files would be really large? Having read your presentation on decoding and the sample made me wonder. I don't have a lot of processing power and disk space available to keep the most granular data so I would consume daily exports and then delete the original files.
As far as I understand the python call api.get_states() gets all the current states on your network. Or does it also include functionality to export historic data?
If this question is too broad I will come back after some more research