Comments (19)
How large of a data set are you subscribing to? For example, how many metadata points exist in the openPDC?
from openhistorian.
Openpdc is connected up 216 PMU (200 Voltage, 600 Currents).
Pietro
from openhistorian.
I wasn't able to reproduce the issue. Can we get the hardware specs of the system running the openHistorian? Also, do you know about how long the openHistorian was running before you took the screenshot?
from openhistorian.
Hardware specs: Dual-core Opteron 2.40 Hz with 8 GB RAM.
About memory, it takes two minutes for reach 8 Gb
from openhistorian.
- I reset Openpdc and openhistorian configuration with "configuration setup utility"
- Openpdc configured with 1 PDC with 18 PMU and for receive internal metadata
- Openhistorian configured for receive external metadata from Openpdc
from openhistorian.
I guess the best thing we can do at this stage since we are not able to replicate your issue is to get a fresh copy of your log files at system start-up. To do this, stop the openHistorian service and delete (or rename) the following files: StatusLog.txt and ErrorLog.txt. Then restart the openHistorian and send us a copy of these log files a after few minutes. This may help us diagnose the issue you are seeing.
from openhistorian.
The openHistorian was originally designed to have a huge memory buffer for the archive files. After using it in production at OG&E, I've determined that Microsoft since Windows 2008 R2 does a decent job caching the files under the surface as long as they stay open. I'm in the process of reworking how aggressive the historian is at caching files. In the mean time, you can edit your application settings. This can be done by changing "MemoryPoolSize" under the "SystemSettings" in the "openHistorian.exe.config" file to something smaller. I think the value is in GB.
from openhistorian.
Now it's openpdc that require huge memory.
In my opinion there exists a trouble in the configuration for internal connection between your openPDC and open Historian. Are configured both for receive internal/external metada? is it correct ?
Thanks
Pietro
from openhistorian.
Can we get a copy of your log files?
from openhistorian.
Health.txt
StatusLog.txt
ErrorLog.txt
from openhistorian.
Note that these logs look to be for the historian. Since the openPDC is the one with a large memory pool, can we get those logs? Note that it would also be helpful to see your Status.txt as well - this file is only logged every thirty minutes, but it shows detailed status of all system adapters.
In the historian logs you provided I did see some errors, e.g.:
Failure code received in response to server command "MetaDataRefresh": Failed to transfer meta-data due to exception: Failed to open ADO data connection, verify "ConnectionString" in configuration file: Authentication to host 'localhost' for user 'root' using method 'mysql_native_password' failed with message: Reading from the stream has failed.
Failed to transfer meta-data due to exception: Failed to open ADO data connection, verify "ConnectionString" in configuration file: Authentication to host 'localhost' for user 'root' using method 'mysql_native_password' failed with message: Reading from the stream has failed.
However, it looks like the system may have recovered from these issues.
Also, are you running on a Virtual Machine?
Thanks,
Ritchie
from openhistorian.
In the logs you have an IEEE C37.118 PDC style connection called PDC12 and a GEP style subscription called HIS. Can you provide a drawing of your configuration? Here is how I would recommend configuration of this system (based on my current understanding):
from openhistorian.
Hi Pietro,
I think Ritchie has the right idea with the architecture diagram. I see a lot of messages in StatusLog.txt about out-of-sequence statistic measurements. Not only is it a highly unusual message, but it seems to be repeating the same IDs and timestamps while the count of out-of-sequence measurements continuously increases. This suggests you may have a data feedback loop, and that would also explain the memory usage going out of control.
It may be easiest to start over from scratch, making your connections according to the suggested architecture diagram posted by Ritchie.
Thanks,
Stephen
from openhistorian.
We are trying to apply the architecture suggested, starting over from scratch.
The files provided are from openpdc folder.
The server is not virtual machine
I change PDC wit single PMU for test.
from openhistorian.
First test
- I start over from scratch openpdc and openhistorian, I have configured one PMU into openPDC
- Openpdc configured for receive internal/external metadata
- Memory required by openpdc increasing
Second Test
- I start over from scratch openpdc and openhistorian, I have configured one PMU into openPDC
- Openhistorian configured for receive internal metadata
- Memory required by openpdc increasing
from openhistorian.
This is an incorrect configuration - so sorry for the confusion. The configuration listed is creating a feed-back loop. I will try to detail the steps:
from openhistorian.
- From openPDC: Connect to PMU
- From openHistorian: Connect to openPDC, steps are as follows
That should correct issue - note that you may need to re-run Configuration Setup Utility for openHistorian and create a new database. Also: With openHisorian service stopped, I would recommend deleting current "C:\Program Files\openHistorian\Archive" folder to clear out current data.
from openhistorian.
Ok now it's working, thanks
from openhistorian.
Excellent!!
from openhistorian.
Related Issues (20)
- API to query measurement details HOT 1
- Data missing on export data from openhistorian webmanager HOT 4
- ATMEGA2560 Modbus openHistorian display to Grafana HOT 8
- Full Documentation for OpenHistorian HOT 3
- Is there any mechanism to store Historian Data directly into any RDBMS like Oracle/SQL Server instead of Files HOT 3
- Update openHistorian Grafana Instance HOT 1
- Multiple indexes
- Service unexpected stop HOT 23
- Grafana and OH User Synchronization requires log-on HOT 2
- Trend/Export Measurements Timestamps HOT 1
- Adding New Device (hardware PMU) HOT 10
- Fix build tools to update version in SDK project files
- Reinstall under different service credentials does not overwrite HTTP reservations HOT 2
- How to disable openHistorian debug host automated start HOT 4
- lossless data compression HOT 4
- How to get openPDC data in openHistorian. HOT 2
- Error in Github Desktop when pulling Source/Libraries/PythonAPIModule' HOT 1
- How to connect openHistorian with other datasources
- Compression algorithm about the OpenHistoian HOT 2
- COMTRADE Export with fields that contain commas
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from openhistorian.