LINUX LOG Time Series

All MOBY's functions and scheduling of data acquisition by MOS are controlled by the MLML Instrument Controller located in the upper instrument bay. The controller logs all daily functions in a number of different ASCII LOg files. There are currently 8 different log files: *_shutdown.log, *_sendmsg.log, *_batt_maint.log, *_session_master.log, *_run_mos.log, *_upload_data.log, *_upload_homeetc.log, and *_set_date.log. The data I thought might be useful are plotted below. These parameters include temperature and humidity of the controller housing, battery status and voltages, flags and other events.

Updated: 22-Jan-2020 15:48:54 - Date of last log file downloaded: 18-Dec-2017 17:05:12 - filename: 20171218_170512_upload_homeetc_NEW.log


Reading for the last day of the run_mos and batt_maint log files: 18-Dec-2017 17:04:30 to 17-Dec-2017 17:06:47 (1 day). Zero values removed from the battery voltages, Art says it will read "0 volts if a measurement is attempted while the battery is being used for something else"
Measurment Mean Min Max %std comment
U0C0, main battery voltage: 12.8512 12.05 13.67 2.86
U0C7, falcon power supply bus: 11.9523 11.75 12.18 0.66
L0C12, lower battery 1 voltage: 11.1811 10.83 11.26 1.19 Disabled
L0C13, lower battery 2 voltage: 15.2411 12.55 18.21 14.41 Disabled
L0C14, lower battery 3 voltage: 10.9475 10.76 11.04 0.80
L0C15, lower battery 4 voltage: 10.8278 10.6 11.25 1.66
U0C1, heatsink temperature: 25.0022 24.98 25.02 0.04
U0C2, case air temperature: 24.9932 24.98 25.01 0.03
U0C3, case humidity: 35.5799 34.11 37.83 1.98
U0C4, +5APwr: 5.0681 5.01 5.08 0.28
step time server -1.264 -1.264 -1.264 0.00

The last 10 batteries charged and the number of hours of daylight the charging occured in
Local Start Time Local Stop Time Battery Total Charging
time (hours)
Daylight Charging
time (hours)
sum of cos(zen)
16-Dec-2017 11:37:02 AM 16-Dec-2017 12:12:36 PM Lower 4 0.59279 0.59279 2.1224
16-Dec-2017 1:09:42 PM 16-Dec-2017 1:50:11 PM Lower 4 0.67499 0.67499 2.0607
16-Dec-2017 2:47:14 PM 16-Dec-2017 5:10:18 PM Upper 2.3847 2.3847 3.7238
16-Dec-2017 5:11:44 PM 16-Dec-2017 6:06:48 PM Upper 0.91778 0.68834 0.22142
16-Dec-2017 6:08:13 PM 17-Dec-2017 7:06:47 AM Upper 12.9761 0 NaN
17-Dec-2017 7:08:11 AM 17-Dec-2017 10:40:24 AM Upper 3.5372 3.5372 5.3286
17-Dec-2017 11:36:58 AM 17-Dec-2017 12:12:31 PM Lower 4 0.5925 0.5925 2.1203
17-Dec-2017 1:09:32 PM 17-Dec-2017 1:50:06 PM Upper 0.67611 0.67611 2.0614
17-Dec-2017 2:47:09 PM 17-Dec-2017 5:09:43 PM Upper 2.3764 2.3764 3.7375
17-Dec-2017 5:11:13 PM 17-Dec-2017 6:04:35 PM Lower 4 0.88946 0.66709 0.23166

Summary graph: Shows when all the logs files where created


Figure 1

COLLATED FROM A NUMBER OF LOG FILES



A compliation of the batt_maint (BML) and run_mos (RML) logs for the U0C0, main battery voltage and U0C7, falcon power supply bus. The below graph is every reading from all the BML and RML files. The Main battery voltages are plotted for when charge is being provided by the solar panels (Cup) and when charge is being sent to the lower bank (Cdwn).

Figure 2

A compliation of the batt_maint (BML) and run_mos (RML) logs for the L0C12-LOC15, lower battery voltage 1 through 4. The below graph is every reading from all the BML and RML files. The lower battery voltages are all, always taken with no load and no charge being directed to them. So the charge was switched to 0 first, before the voltage measurement was taken.

Figure 3

This graph shows which battery is being charged, when MOBY is not acquiring data. The math is done by count the number of times battery x is the last one in a batt_maint.log file. According to Art an even better metric is to look at the last battery selected before shutdown and then the first one its on at boot (should be the same) and compute the time between them. I have check how many times there would be a difference and it is very small. So I am going to leave the math as it is.

When MOBY is acquiring data the battery selected is suppose to also be charged. This in theory should be included in this graph, even thought the battery is also being dischrged at the same time. But we think that the log files may be wrong and that during acquisition the upper battery is being charged. Which is another reason to not include those numbers here.

Figure 4

Same data as the above graph just shown in time series form.

Figure 5

This shows which battery is selcted to be used by MOBY during a file acquisition. In the run_mos log there is a line "writing binary data to:" which tells which MO3 file is being created. I then search for the first "Battery in use by MOS:x1 Charge:x2 BS:x3 RS:x4" line before the "writing binary data to:" and pull the x1 battery number from the line and plot it verses the hour and date of the MOBY file.

Figure 6

Same data as the above graph just shown in bar graph form.

Figure 7

Using the run_mos and batt_maint logs I find the last "Battery in use by MOS:x1 Charge:x2 BS:x3 RS:x4" in each batt_maint logs. I then look for the next run_mos or batt_maint logs "Battery in use by MOS:x1 Charge:x2 BS:x3 RS:x4" and if the x2 number has changed then I calculate the time difference. I should mention this does not include any battery charging happening when MOBY is taking data. I should also mention this includes all log data that is on the ftp site, even test data from the tent. So if one battery is charged for days the scale data can go way off the chart so the max is caped a 50.

Figure 8

Ken wanted to see how much of the charging of the solar panels (especially the 12 hours of charging) was happening in the daylight verses night time. So I created this graph. The dot-dash-dot show the start and stop time for each battery which is being charged. The y-axes is still number of hours charged. The cos of the zenith angle is in black. The yellow and gray patches are day (zenith < 90 deg) and night (zenith > 90 deg). We can see most of the 12 hours of charging is happening over night. This potentially has the same scale problem as the previous graph.

Figure 9

This is my next attempt to figure out the battery charging relationship to the sun. I when through each charging start and stop time and removed any time in which the sun was below the horizon. So you will see that most of the time over 10 hours are gone because most of them where charging overnight. I then calculated a solar zenith angle every 15 minutes for the day light hours and calculated a mean zenith angle. I changed the symbol based on which zenith angle group the charging data set fell in. Of course the longer the charging time the greater the variablity in the sun angle. This potentially has the same scale problem as the previous graph.

Figure 10

So for the previous graph I had calculated the zenith angle every 15 minutes for all the daylight hours. Ken said to take all the 15 minute daylight solar zenith angles and sum the cos of the zenith angle. This should give a good idea of how much sun light is getting onto the solar panels during charging.

Figure 11

So for this graph I summed all the charging being done in one day. This eliminates the scale problem because if one battery is charges for many day the sum is spread out over each day.

Figure 12

This is a plot of the 4 lower batteries measured from a number of sources. The small dots are the measurments from the run_mos and batt_maint logs (unloaded) and the largers symbols are from the TT7 main volts saved in the MOBY file auxilliary data (loaded MOS running and coolers on). The black lines are the min and max of the voltages in the MOBY files. In addition Art saves to the linux log files a print out from MOS of the ADC data. The black star is the TT7 voltage (which is of which ever lower battery is selected) unloaded. Which means MOS is on but the coolers are off. There should be two black stars for each MOBY file. One when MOS is first turned on but before the coolers are turned on and a second on after MOS acquisition and after coolers are off again. The yellow circles are also MOS of the ADC data collected after MOS is first turned on but after the coolers have been on for 15 minutes.

Figure 13

SHUTDOWN LOG INFO



This plot shows the result each time the shutdown script has run. If it runs and finds a "lock" file (basically an indication that something else is still running) it cancels the shutdown. If it runs and "no lock files found" then it shuts down. My best guess at keywords in the file (all of which have a GMT time at the start of the line)

Figure 14

SHUTDOWN LOG INFO



This plot shows the result each time the shutdown script has run. If it runs and finds a "lock" file (basically an indication that something else is still running) it cancels the shutdown. If it runs and "no lock files found" then it shuts down. My best guess at keywords in the file (all of which have a GMT time at the start of the line)

Figure 15

SESSION_MASTER LOG INFO The session_master log is the big picture, of turning on MOBY, taking data and turning MOBY off



My best guess at keywords in the file (all of which have a GMT time at the start of the line)

Figure 16

Shows the start and stop times of the session master file for the last 3 days.

Figure 17
Figure 18

RUN_MOS LOG INFO The run_mos is the log sheet that tells about collecting a MO3 file.



My best guess at keywords in the file (all of which have a GMT time at the start of the line)

Figure 19

The run_mos logs for the U0C0, main battery voltage and U0C7, falcon power supply bus.

Figure 20

The run_mos logs for the U0C1, heatsink temperature and U0C2, case air temperature.

Figure 21

The run_mos logs for the U0C3, case humidity.

Figure 22

The run_mos logs for the U0C4, +5APwr.

Figure 23

The run_mos logs for the U0C9-12, solar panel current 1-4.

Figure 24

The run_mos logs for the U0C13, lower bat charge current, U0C14, upper bat charge current, and U0C15, controller current.

Figure 25

The run_mos logs for the L0C0, regulated voltage and L0C1, unregulated voltage.

Figure 26

The run_mos logs for the L0C7, case air temperature.

Figure 27

The run_mos logs for the L0C8, case humidity.

Figure 28

The run_mos logs for the L0C12-LOC15, lower battery voltage 1 through 4.

Figure 29

So looking at the section of run_mos that acquired the MOBY data. I pulled out some keywords and then have plotted them below to show how long it is taking to acquire a MO3 file. I am not totally sure these are the keywords needed but they do tell a story. The cooler turn on for 15 minutes. Then the acquisition starts. The Closely packed symbols are the Es data before and after the more spaced out x symbols for the Lu data collection. The bigger group of symbols at the end of the file are the Es followed by the reference lamps. Or in the case of the newer faster files the bigger group at the end included the Ed data as well. The black dot at the end is the total time to collect the file. I have also added plotting a magenta triangle with a line for any file that shows data collection started in the log file ("Checking the scan definitions" line) but did not end with "Shutting down MOS", in the legend the string is "No EOF".

Figure 30

BATT_MAINT LOG INFO



My best guess at keywords in the file (all of which have a GMT time at the start of the line)

Figure 31

The batt_maint logs for the U0C0, main battery voltage and U0C7, falcon power supply bus.

Figure 32

The batt_maint logs for the U0C1, heatsink temperature and U0C2, case air temperature.

Figure 33

The batt_maint logs for the U0C3, case humidity.

Figure 34

The batt_maint logs for the U0C4, +5APwr.

Figure 35

The batt_maint logs for the U0C9-12, solar panel current 1-4.

Figure 36

The batt_maint logs for the U0C13, lower bat charge current, U0C14, upper bat charge current, and U0C15, controller current.

Figure 37

The batt_maint logs for the L0C0, regulated voltage and L0C1, unregulated voltage.

Figure 38

The batt_maint logs for the L0C7, case air temperature.

Figure 39

The batt_maint logs for the L0C8, case humidity.

Figure 40

The batt_maint logs for the L0C12-LOC15, lower battery voltage 1 through 4.

Figure 41

UPLOAD_HOMEETC LOG INFO



My best guess at keywords in the file (all of which have a GMT time at the start of the line)

Figure 42

SET_DATA LOG INFO



Looking for set_data messages

Figure 43

THe time adjustments made to the MOBY computer time

Figure 44
Figure 45
Figure 46
Figure 47
Figure 48
Figure 49
Figure 50
Figure 51
Figure 52

Stephanie Flora - Moss Landing Marine Laboratories