Commit Graph

108 Commits

Author SHA1 Message Date
84c1492ce6 fix issues with invalid subfolders, with total walltime reference that may be zero, with the output of progress.yaml for easy parsing to dictionaries, modify config_kokkos.yaml for testing with the OpenMP backend 2024-10-07 12:01:59 -05:00
97920f9fc3 try again with the github step summary 2024-09-30 15:15:30 -05:00
2f53ea37e5 try printing GitHub job summary style 3 2024-09-28 13:31:56 -04:00
c16759ffc3 try printing GitHub job summary style 2 2024-09-28 13:24:41 -04:00
c1040ad9bb try printing GitHub job summary style 1 2024-09-28 13:13:43 -04:00
e8184e63a5 create dummy output files to prevent test job failures 2024-09-11 09:15:05 -04:00
b39386afe5 count all the runs with error and failed num checks as failed 2024-09-10 17:00:57 -05:00
cbbea47718 fix the incorrect keys 2024-09-10 16:22:35 -05:00
8e2dacd0e3 put some cosmetic stuffs 2024-09-10 15:51:04 -05:00
847ce1e363 enable generating new reference log files if desirable 2024-09-10 15:39:52 -05:00
c3162b4488 increase timeout for full regression to 180 seconds. use 8 runners. 2024-09-09 20:29:23 -04:00
274112834b remove double quotes 2024-09-08 17:11:02 -05:00
4d04d8492d report the number of abs and rel diff checks failed 2024-09-08 17:09:05 -05:00
77bf224b3f report if a run is timeout to progress.yaml 2024-09-08 00:24:33 -05:00
57353566d6 one more fix (it is getting late...) 2024-09-07 00:35:57 -04:00
5aea0a061f provide updated reference and update command line 2024-09-07 00:22:56 -04:00
afc9f72887 whitespace 2024-09-06 21:18:31 -04:00
932f10e3b6 update README for syntax and added arguments in run_tests.py 2024-09-06 12:46:42 -05:00
de8dc82801 report walltime normalized by the reference walltime for completed runs in the progress.yaml file 2024-09-06 09:19:00 -05:00
e1d6bb91a8 get reference walltime from running bench/in.lj, guess the default config file if not specified from the command line args 2024-09-06 09:06:45 -05:00
688cff71e6 print out more info for failed tests if verbose is True, indent output 2024-09-05 11:22:00 -05:00
dfd0772aff list the failed tests (including crashed, with error, or numerical checks) into a separate file 2024-09-05 10:38:32 -05:00
4ed5dfe88d reported the total wall time of each run in the progress.yaml file 2024-09-04 15:32:20 -05:00
27d5ad1714 convert string to int 2024-09-01 08:49:13 -04:00
14dc326160 fix typo 2024-09-01 08:36:50 -04:00
6aa6ed86be Curb number of (randomly) selected tests for quick regression run 2024-09-01 08:33:12 -04:00
3ea0612795 small cleanups 2024-09-01 00:39:27 -04:00
af747ac6c0 restore old code structure so we can test subsets again 2024-09-01 00:17:25 -04:00
6fb50cbdc1 integrate quick regression support into regression tester 2024-08-31 23:16:02 -04:00
f5ffb28a1f use the log file with 1 proc in serial runs, removed examples/bpm/impact/brokenDump 2024-08-28 12:57:58 -05:00
a59ac7ec86 Reduced the timeout for quick reg tests 2024-08-26 17:43:36 -05:00
9f20e5b7f7 put a timeout for a run, specified in the config file 2024-08-25 16:19:52 -05:00
04400e10a8 Updated the regression tester run_tests.py to handle list of input scripts 2024-08-25 16:02:16 -05:00
b69a9847f7 add a config file for running regression tests in serial (no mpirun), modify run_tests.py to handle this case 2024-08-23 14:40:07 -05:00
a69356a02f Processed the ERROR line in the output, increased max_np to 4 when no reference log file exists 2024-08-13 15:01:29 -05:00
700a22b7cd Cleaned up and added check for "Total wall time" in the output 2024-08-13 11:03:35 -05:00
bbd72a8960 Switched the order of the checks for ERROR in the output to be first 2024-08-12 09:59:58 -05:00
6b0f529c0b Added more detailed output 2024-08-10 17:52:10 -05:00
1617870fc3 Extracted the compiler name from log file names (g++, or intel) 2024-08-09 23:43:28 -05:00
f4fa78cf03 Fixed issues with detecting the basename of input (e.g. in.min.box) and the log file 2024-08-09 17:17:37 -05:00
f21dec8b06 Fixed issues with empty output, thus no Step nor Loop 2024-08-05 23:40:05 -05:00
c6eb1fb9dd Allowed to skip subfolders from input lists by commenting them out 2024-08-05 16:28:23 -05:00
6671e3b410 Fixed valgrind tests with 1 proc and typo in the config file 2024-08-04 15:26:54 -05:00
7decc33327 Fixed mpiexec valgrind command line, enforced a single proc run 2024-07-30 12:05:47 -05:00
0b4dad1335 Made progress status as a whole string 2024-07-29 12:12:23 -05:00
e870217507 Handled cases to skip when resuming from last progress 2024-07-29 11:45:22 -05:00
3155b6f361 Avoided rewriting progress with completed runs, improved parsing log.lammps to yaml 2024-07-29 09:41:13 -05:00
d101fecf4d Fixed bugs with num_runs undefined 2024-07-28 16:47:56 -05:00
aa32273aa1 Allowed to skip input scripts whose name matches patterns, handled cases where runs completed but log.lammps has irregular format (multi, in.tmd) 2024-07-27 17:10:23 -05:00
ab0da442a4 Handled cases where log files have different thermo ouput columns than the reference log file (in.hyper.local) in subsequent runs 2024-07-26 23:51:23 -05:00