php-src/ext/tokenizer
Nikita Popov 47cf18ba4e Don't include trailing newline in comment token
Don't include a trailing newline in T_COMMENT tokens, instead leave
it for a following T_WHITESPACE token. The newline does not belong
to the comment logically, and this makes for an ugly special case,
as other tokens do not include trailing newlines.

Whitespace-sensitive tooling will want to either forward or backward
emulate this change.

Closes GH-5182.
2020-06-25 11:25:22 +02:00
..
tests Don't include trailing newline in comment token 2020-06-25 11:25:22 +02:00
config.m4 Normalize comments in *nix build system m4 files 2019-05-12 18:43:03 +02:00
config.w32 Sync leading and final newlines in source code files 2018-10-14 12:56:38 +02:00
CREDITS
Makefile.frag Fix #70831: Compile fails on system with 160 CPUs 2015-12-06 12:37:08 +01:00
php_tokenizer.h Remove mention of PHP major version in Copyright headers 2019-09-25 14:51:43 +02:00
tokenizer.c Add helper APIs for maybe-interned string creation 2020-06-08 15:31:52 +02:00
tokenizer.stub.php Generate function entries from stubs for a couple of extensions 2020-04-14 11:49:02 +02:00
tokenizer_arginfo.h Include stub hash in generated arginfo files 2020-06-24 09:55:19 +02:00
tokenizer_data.c Make throw statement an expression 2020-04-23 12:51:23 +02:00
tokenizer_data_gen.sh Add PhpToken class 2020-03-26 11:09:18 +01:00