HW-Time-Slice Firmware-Filter Software vx2740 Steering Module Reports MVM MVM Vexos MVM-Bug listing MVM TRIUMF Local DS Prototype DS Cryogenic For Shifters BCIT-31 ChronoBox Run Operation DS-DAQ
  CERN DS-Proto0 read-only backup, Page 6 of 8  Not logged in ELOG logo
IDup Date Author Type Category Subject
  104   09 Nov 2019 00:13 Xiang XiaoRoutineGeneralMorning data taking

"ERROR INFO: 10:38:10.924 2019/11/09 [feov1725MTI00,ERROR] [feoV1725.cxx:1048:read_trigger_event,ERROR] Error: did not receive a ZMQ bank after 100.000000 ms. Stopping run."

Emailed to Ben.

 

Run 999

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 2.8 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  233 mbarg

SiPM HV: 65 V

Number of events: 10k

 

Run 1000

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  235 mbarg

SiPM HV: 65 V

Number of events: 10k

 

Run 1001

Gas pocket: ON (thinkness 7mm)

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  238 mbarg

SiPM HV: 65 V

Number of events: 10k

 

Run 1002

Gas pocket: ON (thinkness 7mm)

Fields: OFF

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  238 mbarg

SiPM HV: 65 V

Number of events: 10k

 

Run 1003 Laser run (manually stopped)

Chronobox: External trigger Enable

Chronobox: Enable Channel [ch_enable]: 0x00000000

Laser Intensity: MIN

Threshold: external clock (laser NIM), laser set to 1kHz

Trace length: 12us, 5us pre-trigger

SIPM HV: 65V

Comment: Triger rate too low (~8 Hz), manually stopped

 

Run 1004 Laser run (manually stopped)

Chronobox: External trigger Enable

Chronobox: Enable Channel [ch_enable]: 0x00000000

Laser Intensity: MIN

Threshold: external clock (laser NIM), laser set to 1kHz

Trace length: 12us, 5us pre-trigger

SIPM HV: 65V

Comment: Triger rate too low (~8 Hz), manually stopped

 

  105   09 Nov 2019 07:29 Marco RescignoProblem FixedMIDASthis morning problem

frontend process still alive but slow, causing lot of rejected triggers.

stopped and restarted the feov1725 process to fix this

  106   09 Nov 2019 09:39 Sam HillRoutineGeneralEvening data taking

Run 1016

Gas pocket: ON (thinkness 7mm)

Fields: Off

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure: 201 mbarg

SiPM HV: 65 V

Number of Events: 10K

 

Run 1017

Gas pocket: ON (thinkness 7mm)

Fields:  drift 200 V/cm, extraction 2.8 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure: 201 mbarg

SiPM HV: 65 V

Number of Events: 10K

 

Run 1018

Gas pocket: ON (thinkness 7mm)

Fields:  drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure: 217 mbarg

SiPM HV: 65 V

Number of Events: 10K

 

Run 1019

Gas pocket: ON (thinkness 7mm)

Fields:  drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure: 240

SiPM HV: 65 V

Number of Events: 10K

 

Run 1020 Laser Run

Chronobox: External trigger Enable

Chronobox: Enable Channel [ch_enable]: 0x00000000

Laser Intensity: MAX

Threshold: external clock (laser NIM), laser set to 1kHz

Trace length: 12us, 5us pre-trigger

SIPM HV: 65V

Comment: Recieved this error message but run seemed to continue ok and data appeared to be written: 19:56:04.839 2019/11/09 [feov1725MTI00,ERROR] [feoV1725.cxx:1048:read_trigger_event,ERROR] Error: did not receive a ZMQ bank after 100.000000 ms. Stopping run.   â•³

Run 1021 Laser Run

Chronobox: External trigger Enable

Chronobox: Enable Channel [ch_enable]: 0x00000000

Laser Intensity: MIN

Threshold: external clock (laser NIM), laser set to 1kHz

Trace length: 12us, 5us pre-trigger

SIPM HV: 65V

 

 

 

  107   10 Nov 2019 00:06 Yi WangRoutineGeneralmorning data taking

Run 1022

Gas pocket: ON (thinkness 7mm)

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADCc below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  159 mbarg

SiPM HV: 65 V

Number of events: 10k

 

Run 1024

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  186 mbarg

SiPM HV: 65 V

Number of events: 10k

 

Run 1025

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 2.8 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  207 mbarg

SiPM HV: 65 V

Number of events: 10k

 

Run 1026

Gas pocket: ON (thinkness 7mm)

Fields: OFF

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  225 mbarg

SiPM HV: 65 V

Number of events: 10k

 

Run 1028 Laser run

Chronobox: External trigger Enable

Chronobox: Enable Channel [ch_enable]: 0x00000000

Laser Intensity: MAX

Threshold: external clock (laser NIM), laser set to 1kHz

Trace length: 12us, 5us pre-trigger

SIPM HV: 65V

Number of events: 100k

 

Run 1029 Laser run

Chronobox: External trigger Enable

Chronobox: Enable Channel [ch_enable]: 0x00000000

Laser Intensity: MIN

Threshold: external clock (laser NIM), laser set to 1kHz

Trace length: 12us, 5us pre-trigger

SIPM HV: 65V

Number of events: 100k

  108   10 Nov 2019 08:04 Edgar SanchezRoutineGeneralS1 data taking with field

Run 1032

Gas pocket: OFF

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 100 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate: 800 Hz

Run 1033

Gas pocket: OFF

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 200 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate: 350 Hz

Run 1034

Gas pocket: OFF

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 250 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate: 260 Hz

Run 1035

Gas pocket: OFF

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 400 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate: 200 Hz

Run 1036

Gas pocket: OFF

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 600 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate: 130 Hz

 

"ERROR INFO: 17:19:23.176 2019/11/10 [feov1725MTI00,ERROR] [feoV1725.cxx:1048:read_trigger_event,ERROR] Error: did not receive a ZMQ bank after 100.000000 ms. Stopping run."

Run 1037

Gas pocket: OFF

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 800 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate:  110 Hz

Run 1038

Gas pocket: OFF

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate:  80 Hz

Run 1039

Gas pocket: OFF

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 150 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate:  400 Hz

 

  109   10 Nov 2019 08:40 Edgar SanchezRoutineGeneralS1 data taking without field

Run 1041

Gas pocket: OFF

Fields: OFF

Threshold: 100 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate: 360 Hz

Run 1042

Gas pocket: OFF

Fields: OFF

Threshold: 200 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate: 340 Hz

Run 1043

Gas pocket: OFF

Fields: OFF

Threshold: 250 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate: 290 Hz

Run 1044

Gas pocket: OFF

Fields: OFF

Threshold: 400 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate: 240 Hz

Run 1045

Gas pocket: OFF

Fields: OFF

Threshold: 600 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate: 170 Hz

Run 1046

Gas pocket: OFF

Fields: OFF

Threshold: 800 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate:  140 Hz

Run 1047

Gas pocket: OFF

Fields: OFF

Threshold: 1000 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate:  110 Hz

Run 1048

Gas pocket: OFF

Fields: OFF

Threshold: 150 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate:  400 Hz

Run 1049

Gas pocket: OFF

Fields: OFF

Threshold: 100 ADCc below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  340 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate:  400 Hz

  110   10 Nov 2019 11:18 Edgar SanchezRoutineGeneralAfternoon system monitoring

Run 1050

Gas pocket: ON (unknow)

Fields: drift 200 V/cm, extraction 2.8 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  245 mbarg

SiPM HV: 65 V

Number of events: 10k

Run 1051

Gas pocket: ON (unknow)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  260 mbarg

SiPM HV: 65 V

Number of events: 10k

Run 1052

Gas pocket: ON (thinkness 7mm)

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  245 mbarg

SiPM HV: 65 V

Number of events: 10k

Stopped. Problem with DAQ

  111   10 Nov 2019 11:19 Edgar SanchezRoutineGeneralS1 + S2 short time window

Run 1054

Gas pocket: ON (unknow)

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 100 ADC below baseline

Trace length: 30us total, 5 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  240 mbarg

SiPM HV: 65 V

Number of events: 50k

Rate: 400 Hz 

 

 

  112   10 Nov 2019 12:15 E. SanchezProblemMIDASProblem DAQ

Error during data taking  1573416708 21:11:48.151 2019/11/10 [feov1725MTI00,INFO] V1725 PLL loss lock Board:0 (vmeAcq=0x0)

It stop saving event but run in process. Impossible to stop the run. I tried to reset feov1725MTl00. After that error: 

1573416857 21:14:17.792 2019/11/10 [feChronoEsper,INFO] Client 'feov1725MTI00' on database 'ODB' removed by db_cleanup called by cm_periodic_tasks because pid 9724 does not exist

Run stopped after some time. Error 21:21:19.121 2019/11/10 [mhttpd,ERROR] [midas.cxx:3951:cm_transition_call,ERROR] cannot connect to client "feov1725MTI00" on host localhost, port 40944, status 503   ╳

Trying to restart feov1725MTI00. Status initializing

It is not possible to initialize 

 

 

  113   11 Nov 2019 00:37 Yi WangProblemMIDAScannot connect to rootana

The connection to rootana is lost.

No data taking can be started.

  114   11 Nov 2019 00:47 Yi / EdgarProblem FixedDigitizerProblem fixed by restarting the VME crate
  115   11 Nov 2019 01:12 Yi / EdgarRoutineGeneralMorning data taking

Run 1065

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADCc below baseline

Trace length: 100us total, 80 us post-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  260 mbarg

SiPM HV: 65 V

Number of events: 20k

 

Run 1066

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 500 ADCc below baseline

Trace length: 100us total, 80 us post-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  260 mbarg

SiPM HV: 65 V

Number of events: 20k

 

Run 1067

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 200 ADCc below baseline

Trace length: 100us total, 80 us post-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  260 mbarg

SiPM HV: 65 V

Number of events: 20k

  116   11 Nov 2019 09:31 Sam HillRoutineGeneralAfternoon system monitoring: IV curves and Dewar refill

17:30

Took a set of IV curves using 0.5V steps from 30-50V and 0.05 steps above 50V.

Curves all look as expected, although reducing the step size makes the breakdown voltage harder to see on the plots.

Will use 0.02V steps in future.

Data can be found on dsproto machine at: /home/dsproto/online/dsproto_sy4527/ivdata_191111

Summary plot attached to this entry.

19:15

Refilled outer dewar for 10 mins

Attachment 1: summaryPlot_191111.png
summaryPlot_191111.png
  117   11 Nov 2019 10:05 Sam HillProblemGeneralEvening data taking

Attemted the following run, and it started but the rate was shoing 0 and it got stuck on 5 events

Was unable to connect to Chronobox webpage even after turning VME crate off and on.

Abandoned run and will attempt to fix in the morning.

Run 1073

Gas pocket: ON (thickness unknown)

Fields:  drift 200 V/cm, extraction 2.8 kV/cm

Threshold: 1000 ADC below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  252mbarg

SiPM HV: 65 V

Number of Events: 10K

 

  118   11 Nov 2019 23:57 Yi WangProblem FixedTriggerID 117 problem is fixed

The problem reported in ID 117 is somehow fixed this morning.

  119   12 Nov 2019 00:16 Yi WangProblemDigitizerV1725 error, runs keep crashing

09:15:33.955 2019/11/12 [feov1725MTI00,ERROR] [feoV1725.cxx:663:link_thread,ERROR] Exiting thread 3 with error

  120   12 Nov 2019 00:23 Ben SmithProblemDigitizerV1725 error, runs keep crashing
It looks like there's a memory leak in the high voltage driver, and we were running out of memory (using a lot of swap). That *may* be related to the recent instability, but I'm not sure.

If things are more stable now, then the memory leak was probably the cause. If not, then we should try stopping the V1725 program, power-cycling the VME crate, then starting the V1725 program.


Yi: restarted the VME crate twice, now it seems like smooth.
  121   12 Nov 2019 00:24 Yi WangRoutineGeneralMorning data taking

Run 1084

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 500 ADCc below baseline

Trace length: 100us total, 50 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  240 mbarg

SiPM HV: 65 V

Number of events: 20k

 

Run 1085

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 200 ADCc below baseline

Trace length: 100us total, 50 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  240 mbarg

SiPM HV: 65 V

Number of events: 20k

 

Run 1086

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADCc below baseline

Trace length: 100us total, 50 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  240 mbarg

SiPM HV: 65 V

Number of events: 6k

Run crashed: 09:31:55.239 2019/11/12 [feov1725MTI00,ERROR] [feoV1725.cxx:663:link_thread,ERROR] Exiting thread 0 with error

  122   12 Nov 2019 09:22 Edgar SanchezRoutineGeneralAfternoon system monitoring

Run 1090

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADCc below baseline

Trace length: 100us total, 50 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  220 mbarg

SiPM HV: 65 V

Number of events: 10k

Run 1091

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 400 ADCc below baseline

Trace length: 100us total, 50 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  220 mbarg

SiPM HV: 65 V

Number of events: 10k

  123   12 Nov 2019 09:30 Edgar SanchezRoutineGeneralAfternoon system monitoring

Run 1092

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADCc below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  220 mbarg

SiPM HV: 65 V

Number of events: 10k

Run 1093

Gas pocket: ON (thinkness 7mm)

Fields: drift 500 V/cm, extraction 3.78 kV/cm

Threshold: 1000 ADCc below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  220 mbarg

SiPM HV: 65 V

Number of events: 10k

Run 1094

Gas pocket: ON (thinkness 7mm)

Fields: drift 200 V/cm, extraction 2.8 kV/cm

Threshold: 1000 ADCc below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  220 mbarg

SiPM HV: 65 V

Number of events: 10k

Run 1095

Gas pocket: ON (thinkness 7mm)

Fields: OFF 

Threshold: 1000 ADCc below baseline

Trace length: 200us total, 100 us pre-trigger

Threshold extend:  5x16 = 80ns

TPC Pressure:  220 mbarg

SiPM HV: 65 V

Number of events: 10k

ELOG V3.1.4-cb3afcd8