Conversation
|
Yeah OK - so one approach could be to only provide the time resolution and aggregation function for values that have been resampled from the instantaneous data. You're right - I think it's unlikely that 15 minute data has been aggregated, although it's possible of course (especially nowadays, with edge computing and when the data storage cost of having very high resolution readings is negligible). Hourly is getting quite coarse for instantaneous measurements - OK for bigger rivers but for smaller rivers I should think most hydrometric agencies would take readings at a finer time resolution, because a flood peak could be missed. This also relates back to our discussion somewhere else about the The naming convention we have currently adopted indicates an instantaneous value by not providing the aggregation function - e.g. |
|
Some APIs seem to related to this data simply as "discharge_point", which could be used for both, 15min and irregular. I want to prevent that we start adding different string combinations for every other fetcher, because in the end you have thousands of different variable names for discharge. To me, it should be clear from the name if the data is a) aggregated and b) if it is at a fine or coarse resolution. If it is 15min/irregular, I know that I have to resample it to daily means before I can combine it with discharge_daily. But if it is 15min or irregular, is not like that makes a huge difference for me? The data will be stored in separate files anyway, no? |
|
OK - I agree we want to limit the string combinations. So are you suggesting something like |
|
Yes, I was thinking along those lines. If some data provider would have hourly discharge, then this would probably be discharge_hourly_mean but point/instantaneous and 15min data seems to be equivalent (besides the difference in temporal regularity). |
|
OK - sounds good to me. |
…eval in france. (#46) * get_data now returns time indexed dataframes * Refactor: New names, Extended USA and South Africa, Fixed France * Change 15min name to instantaneous
Thiis is a bit of a hail marry pull requests that does many things at once. It wasn't planned like this, but while refactoring the names according to the discussion in #3 I also noticed:
Fixes #3
@simonmoulds Before I merge this, we should maybe discuss if we need a variable name with "instantaneous" and "15min". From what I gather, everyone who provides "15min" data, calls this "instantaneous" e.g. USGS, UK-EA, and then in South Africa, instantaneous are random timesteps. The point here is that from what I can tell, there are no aggregations happening over 15min data. So everything can be considered instantaneous that is at this temporal interval. And tbh, I think having e.g. the sub-hourly data from South-Africa under a different name, just because they don't seem to log in a regular interval, than other countries, sounds weird. I don't have a strong opinion though.