Eagle.io enforces some basic historic data limits to ensure the platform remains performant and provides the best user experience.
Note
If you believe your application may exceed our historic limits, please contact us to discuss your requirements.
Eagle.io supports the acquisition and storage of up to 20000 records per Data Source per day. Exceeding the limit will trigger an Overload Alarm on the Source.
Daily intervals are defined in the UTC time zone. The acquisition limit applies to the number of records acquired in one UTC day, regardless of the record timestamps. The storage limit applies to the number of records that have timestamps occurring on the same UTC day, regardless of when they are acquired.
The limit of 20000 records is sufficient for Data Sources that generate data continuously at 5-second intervals. While eagle.io supports smaller data intervals (down to 1 millisecond), such resolutions cannot be generated continuously. For example, if a Data Source generated data at 1-second intervals, the limit of 20000 records would be reached in under 6 hours.
Under some circumstances, a Data Source will be exempt from the acquisition limit (but will always be subject to the storage limit of 20000 records per day):
This exemption from the acquisition limit allows a large number of historical records to be backfilled at one time; however, each individual day of data must still not have more than 20000 records. For example, when connecting a new data logger that has been logging data at 5-second intervals for 1 month, all the data on the device can be acquired by eagle.io in a single attempt, even though this is over 500000 records. Note that each individual day of data still does not contain more than 20000 records, and so does not exceed the storage limit.
The acquisition limit and storage limit have different effects, highlighted by the following examples.
Consider a data set spanning 1 week at 5-second resolution, i.e. 17280 records per day, for a total of 120960 records. If you tried to acquire all these records in one attempt, you would hit the daily limit of 20000 records acquired per day, even though each individual day of records is under the storage limit. The following day, you would be able to acquire a further 20000 records. In total, you would need to perform daily acquisitions for a week, adding only 20000 records per day, to acquire the entire data set. However, if any of the previously listed exemptions applied to the Data Source, you would be able to acquire all 120960 records in a single attempt.
Consider a data set spanning 1 day at 1-second resolution, i.e. a total of 86400 records with timestamps all occurring on the same day. If you only acquired 1000 of these records each day, you would not hit the daily acquisition limit. However, after 20 days, you would hit the storage limit of 20000 records with timestamps occurring on the same day. You would then be permanently restricted from storing any more records with timestamps occurring on that day. There are no exemptions to the storage limit, so the only way to store additional records on that day would be to delete some or all of the existing records.
Eagle.io limits the number of raw records that are loaded on a historic chart to 50000 records per parameter while editing. If your time range selection exceeds the record limit a notice will be shown in the top-left corner of the chart with an option to temorarily ignore the warning and load the full dataset (please be aware this may result in poor browser performance and stability issues).