Commit Graph

101 Commits

Author SHA1 Message Date
cbbea47718 fix the incorrect keys 2024-09-10 16:22:35 -05:00
8e2dacd0e3 put some cosmetic stuffs 2024-09-10 15:51:04 -05:00
847ce1e363 enable generating new reference log files if desirable 2024-09-10 15:39:52 -05:00
c3162b4488 increase timeout for full regression to 180 seconds. use 8 runners. 2024-09-09 20:29:23 -04:00
274112834b remove double quotes 2024-09-08 17:11:02 -05:00
4d04d8492d report the number of abs and rel diff checks failed 2024-09-08 17:09:05 -05:00
77bf224b3f report if a run is timeout to progress.yaml 2024-09-08 00:24:33 -05:00
57353566d6 one more fix (it is getting late...) 2024-09-07 00:35:57 -04:00
5aea0a061f provide updated reference and update command line 2024-09-07 00:22:56 -04:00
afc9f72887 whitespace 2024-09-06 21:18:31 -04:00
932f10e3b6 update README for syntax and added arguments in run_tests.py 2024-09-06 12:46:42 -05:00
de8dc82801 report walltime normalized by the reference walltime for completed runs in the progress.yaml file 2024-09-06 09:19:00 -05:00
e1d6bb91a8 get reference walltime from running bench/in.lj, guess the default config file if not specified from the command line args 2024-09-06 09:06:45 -05:00
688cff71e6 print out more info for failed tests if verbose is True, indent output 2024-09-05 11:22:00 -05:00
dfd0772aff list the failed tests (including crashed, with error, or numerical checks) into a separate file 2024-09-05 10:38:32 -05:00
4ed5dfe88d reported the total wall time of each run in the progress.yaml file 2024-09-04 15:32:20 -05:00
27d5ad1714 convert string to int 2024-09-01 08:49:13 -04:00
14dc326160 fix typo 2024-09-01 08:36:50 -04:00
6aa6ed86be Curb number of (randomly) selected tests for quick regression run 2024-09-01 08:33:12 -04:00
3ea0612795 small cleanups 2024-09-01 00:39:27 -04:00
af747ac6c0 restore old code structure so we can test subsets again 2024-09-01 00:17:25 -04:00
6fb50cbdc1 integrate quick regression support into regression tester 2024-08-31 23:16:02 -04:00
f5ffb28a1f use the log file with 1 proc in serial runs, removed examples/bpm/impact/brokenDump 2024-08-28 12:57:58 -05:00
a59ac7ec86 Reduced the timeout for quick reg tests 2024-08-26 17:43:36 -05:00
9f20e5b7f7 put a timeout for a run, specified in the config file 2024-08-25 16:19:52 -05:00
04400e10a8 Updated the regression tester run_tests.py to handle list of input scripts 2024-08-25 16:02:16 -05:00
b69a9847f7 add a config file for running regression tests in serial (no mpirun), modify run_tests.py to handle this case 2024-08-23 14:40:07 -05:00
a69356a02f Processed the ERROR line in the output, increased max_np to 4 when no reference log file exists 2024-08-13 15:01:29 -05:00
700a22b7cd Cleaned up and added check for "Total wall time" in the output 2024-08-13 11:03:35 -05:00
bbd72a8960 Switched the order of the checks for ERROR in the output to be first 2024-08-12 09:59:58 -05:00
6b0f529c0b Added more detailed output 2024-08-10 17:52:10 -05:00
1617870fc3 Extracted the compiler name from log file names (g++, or intel) 2024-08-09 23:43:28 -05:00
f4fa78cf03 Fixed issues with detecting the basename of input (e.g. in.min.box) and the log file 2024-08-09 17:17:37 -05:00
f21dec8b06 Fixed issues with empty output, thus no Step nor Loop 2024-08-05 23:40:05 -05:00
c6eb1fb9dd Allowed to skip subfolders from input lists by commenting them out 2024-08-05 16:28:23 -05:00
6671e3b410 Fixed valgrind tests with 1 proc and typo in the config file 2024-08-04 15:26:54 -05:00
7decc33327 Fixed mpiexec valgrind command line, enforced a single proc run 2024-07-30 12:05:47 -05:00
0b4dad1335 Made progress status as a whole string 2024-07-29 12:12:23 -05:00
e870217507 Handled cases to skip when resuming from last progress 2024-07-29 11:45:22 -05:00
3155b6f361 Avoided rewriting progress with completed runs, improved parsing log.lammps to yaml 2024-07-29 09:41:13 -05:00
d101fecf4d Fixed bugs with num_runs undefined 2024-07-28 16:47:56 -05:00
aa32273aa1 Allowed to skip input scripts whose name matches patterns, handled cases where runs completed but log.lammps has irregular format (multi, in.tmd) 2024-07-27 17:10:23 -05:00
ab0da442a4 Handled cases where log files have different thermo ouput columns than the reference log file (in.hyper.local) in subsequent runs 2024-07-26 23:51:23 -05:00
50bf022946 Improved error messages in the log files 2024-07-26 15:19:01 -05:00
e0857ad558 Handled more cases with ERROR in log.lammps 2024-07-26 14:11:43 -05:00
5bcf124431 Converted the return results from iterate() into a dict, processed memory leaks if valgrind is used 2024-07-26 12:23:58 -05:00
59ef492982 Handled a few cases with mismatched columns in thermo output 2024-07-26 09:51:19 -05:00
1a344853e0 Added more info on the number of input scripts per subfolder 2024-07-25 16:49:53 -05:00
0c5b9175d6 Fixed an issue with num_ref_runs not specified before use 2024-07-25 13:26:47 -05:00
f84b18170f Reported different outcomes for the test runs, priotized running the input first, then processing the output, mem leaks and finally numerical checks 2024-07-25 12:19:00 -05:00