Commit graph

145 commits

Author SHA1 Message Date
John Hawthorn
1582bd9382 Add Timeout message when bootstraptest times out 2025-07-11 10:20:50 -07:00
Takashi Kokubun
57f4460f0c
ZJIT: Skip a hanging ractor test (#13774) 2025-07-03 09:22:45 -07:00
Nobuyoshi Nakada
4a67ef09cc
[Feature #21116] Extract RJIT as a third-party gem 2025-02-13 18:01:03 +09:00
Nobuyoshi Nakada
a37a2f5fef
Clear failure_log by assignment like as appending by assignment 2024-12-27 11:23:23 +09:00
Alan Wu
57825bf390 bootstraptest: On -j failure, show total test count
It used to always try to divide by zero like:

    FAIL 1/0 tests failed
2024-12-12 19:54:37 -05:00
Naoto Ono
de50236c3a
Enable Launchable integration in compilers.yml (#12136) 2024-12-03 15:02:18 +09:00
Naoto Ono
d9bff41637 Rename a variable name 2024-07-19 16:39:21 +09:00
Naoto Ono
09dd9a0457 Launchable: Aggregate test results based on file level 2024-07-19 16:39:21 +09:00
Nobuyoshi Nakada
690b56440b
Use File.write instead of Kernel#open 2024-07-09 13:01:44 +09:00
Naoto Ono
8ede84aa95 Move the file location of launchable.rb 2024-07-08 10:15:04 +09:00
Naoto Ono
5b78925455 Integrate Launchable into make btest 2024-07-08 10:15:04 +09:00
Koichi Sasada
30a8dbc861 maximum showing line number on btest failure
Some tests in btest uses long src for btest and it is harmful to
check the results. This patch introducing the limitation how many
lines of code is shown on failure.
2024-07-01 12:11:28 +09:00
Koichi Sasada
448efa90af respect RUBY_TEST_TIMEOUT_SCALE
GC benchmarks will spend long time with assertions so we need
to respect `RUBY_TEST_SUBPROCESS_TIMEOUT_SCALE` environment variable.

@nobu pointed out that now `RUBY_TEST_TIMEOUT_SCALE` is primary
(and `RUBY_TEST_SUBPROCESS_TIMEOUT_SCALE` was obsolete so check both
and will remove it later.
2024-06-10 13:32:14 +09:00
Matt Valentine-House
c90cb4d743 Fix pathes => paths typo in bootstrap test runner 2024-06-04 20:34:19 +01:00
Nobuyoshi Nakada
937cb1176d
Fix regexps for abbreviated options 2024-04-28 00:06:24 +09:00
Nobuyoshi Nakada
a0b4f0bcc9
Timeout scale in bootstraptest 2024-04-28 00:03:09 +09:00
Nobuyoshi Nakada
602193ded7
Timeout in bootstraptest 2024-04-28 00:02:33 +09:00
Alan Wu
478b4ef9de
Fix nil error with KNOWNBUGS.rb
Previously, `make test-knownbugs` crashed with `NoMethodError` due to
the failed regex match if there is a test case in KNOWNBUGS.rb.

The note about 1.8 compatibility is probably bogus as we require a way
more recent BASERUBY now.
2024-04-08 12:31:33 -04:00
Jean Boussier
91bf7eb274 Refactor frozen_string_literal check during compilation
In preparation for https://bugs.ruby-lang.org/issues/20205.

The `frozen_string_literal` compilation option will no longer
be a boolean but a tri-state: `on/off/default`.
2024-03-15 15:52:33 +01:00
Jean Boussier
09d8c99cdc Ensure test suite is compatible with --frozen-string-literal
As preparation for https://bugs.ruby-lang.org/issues/20205
making sure the test suite is compatible with frozen string
literals is making things easier.
2024-03-14 17:56:15 +01:00
Peter Zhu
7ac74f5c77 Revert "Skip a failing test for Prism"
This reverts commit 557b69e83b.
2024-01-23 15:23:48 -05:00
Takashi Kokubun
557b69e83b Skip a failing test for Prism
This should be reverted once https://github.com/ruby/prism/issues/2249
is closed.
2024-01-23 11:00:05 -08:00
Takashi Kokubun
2918e43dee Skip a flaky Ractor test for YJIT
`[BUG] pthread_mutex_lock: Invalid argument (EINVAL)` doesn't seem like
a fault of YJIT?

2073675497
2073957248
2024-01-22 10:31:21 -08:00
Takashi Kokubun
78b27ce62a RJIT: Streamline RJIT enablement check
in bootstrap tests so that `make btest-bruby` skips the right tests.
2023-12-21 14:32:03 -08:00
Koichi Sasada
9b4cb69a88 support skip in bootstraptest 2023-12-16 01:00:01 +09:00
Takashi Kokubun
7f696b8859 Remove a warning in bootstraptest/runner.rb
../bootstraptest/runner.rb:121: warning: assigned but unused variable - e
2023-03-19 21:02:21 -07:00
Takashi Kokubun
2e875549a9 s/MJIT/RJIT/ 2023-03-06 23:44:01 -08:00
Nobuyoshi Nakada
b02b8e7756
Let other test runners follow the change of GNU make 4.4 jobserver 2022-11-07 10:08:30 +09:00
Nobuyoshi Nakada
88c12a2937
Indent folded bootstraptest dots 2022-10-01 18:53:41 +09:00
Nobuyoshi Nakada
942066713b
bootstraptest/runner: run in parallel if in parallel build 2022-09-29 14:09:25 +09:00
Nobuyoshi Nakada
09bce061af bootstraptest/runner: manage sub processes with the job server 2022-09-28 23:18:55 +09:00
Nobuyoshi Nakada
fc54dbe8b4 bootstraptest/runner: fold dots by window size 2022-09-28 23:18:55 +09:00
Nobuyoshi Nakada
12e5e5b573
Fix the option name in the error message [ci skip] 2022-09-19 14:15:13 +09:00
Nobuyoshi Nakada
c8b414b334
Reuse -v option result as target_platform
Backticks method invokes `/bin/sh` when the command contains
quotes, and `sh` clears some environment variables set in
runruby.rb to search the built shared library.
2022-02-17 20:12:38 +09:00
Koichi Sasada
fdf0f8d814 btest-ruby OPTS=-v should disable quiet
`make btest-ruby` is run with -q (quiet) option and -v should
remove -q option.
2022-02-17 18:58:37 +09:00
Koichi Sasada
603ab70961 support concurrent btest execution
* `-j` option for concurrent test with threads
  * `-jN` uses N threads
  * `-j` uses nproc/2 threads
* Introduce `BT` struct to manage configurations
* Introduce `Assertion` to manage all assertions
* Remove all toplevel instance variables
* Show elapsed seconds at last

```
$ time make btest
...
real    0m37.319s
user    0m26.221s
sys     0m16.534s

$ time make btest TESTOPTS=-j
...
real    0m11.812s
user    0m36.667s
sys     0m21.872s
```
2022-02-06 03:05:47 +09:00
Koichi Sasada
e953d68657 refactoring btest output
don't duplicate the message, but prepare `out` var to choose
stdout/err.
2022-01-26 09:56:27 +09:00
Koichi Sasada
5e3a320218 respect --quiet option for btest
Do not print anymore except errors.
2022-01-21 17:38:11 +09:00
Yuta Saito
dd99ee1f7d [wasm] bootstraptest, basictest: disable backquote literal tests
WASI doesn't support spawning a new process for now.
2022-01-19 11:19:06 +09:00
Takashi Kokubun
1a63468831
Prepare for removing RubyVM::JIT (#5262) 2021-12-13 23:07:46 -08:00
Takashi Kokubun
e1fee7f949
Rename RubyVM::MJIT to RubyVM::JIT
because the name "MJIT" is an internal code name, it's inconsistent with
--jit while they are related to each other, and I want to discourage future
JIT implementation-specific (e.g. MJIT-specific) APIs by this rename.

[Feature #17490]
2021-01-13 22:46:51 -08:00
Takashi Kokubun
aacd2295d0
Debug the command used for gdb dump
It's not working
http://ci.rvm.jp/results/trunk-mjit@phosphorus-docker/3288206. I'm
debugging why.
2020-12-13 23:35:29 -08:00
Takashi Kokubun
8d83334a69
@ruby is the target Ruby in bootstraptest 2020-12-13 23:33:59 -08:00
Takashi Kokubun
246d7e4f1d
Dump a backtrace with gdb
Because Ruby often fails to dump a C backtrace.
2020-12-12 18:46:24 -08:00
Takashi Kokubun
4439b78336
Save a core file from bootstraptest 2020-12-10 21:36:48 -08:00
Benoit Daloze
b4ec4a41c2 Guard all accesses to RubyVM::MJIT with defined?(RubyVM::MJIT) &&
* Otherwise those tests, etc cannot run on alternative Ruby implementations.
2020-12-04 16:45:54 +01:00
Koichi Sasada
ed22bf47cc display stderr output even if core dump files
On btest, stderr messages are not displayed if core files are
generated. There is no reason to skip it, so this patch display
stderr and check core files.
2020-07-29 18:45:39 +09:00
Nobuyoshi Nakada
c2428b8bf6
Erase only on tty 2019-07-29 23:05:41 +09:00
Nobuyoshi Nakada
f47254d216
colors file has been moved from test to tool 2019-07-02 09:19:38 +09:00
Nobuyoshi Nakada
7f4f40ab31
bootstraptest/runner.rb (show_limit): defer messages unless verbose and a tty 2019-07-01 17:09:08 +09:00