summaryrefslogtreecommitdiff
path: root/Master/tlpkg/tlperl/lib/pods/perl5113delta.pod
blob: 5c4e19660270dbd47b93f7cbac1bb93b6ba3db81 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
=head1 NAME

perl5113delta - what is new for perl v5.11.3

=head1 DESCRIPTION

This document describes differences between the 5.11.2 release and
the 5.11.3 release.

If you are upgrading from an earlier release such as 5.11.1, first read
the L<perl5112delta>, which describes differences between 5.11.1 and
5.11.2

=head1 Incompatible Changes

=head2 Filehandles are blessed directly into C<IO::Handle>, as C<FileHandle> is merely a wrapper around C<IO::Handle>.

The previous behaviour was to bless Filehandles into L<FileHandle>
(an empty proxy class) if it was loaded into memory and otherwise
to bless them into C<IO::Handle>.

=head1 Core Enhancements

=head2 Unicode version

Perl is shipped with the latest Unicode version, 5.2, dated October 2009.  See
L<http://www.unicode.org/versions/Unicode5.2.0> for details about this release
of Unicode.  See L<perlunicode> for instructions on installing and using
older versions of Unicode.

=head2 Unicode properties

Perl can now handle every Unicode character property.  A new pod,
L<perluniprops>, lists all available non-Unihan character properties.  By
default the Unihan properties and certain others (deprecated and Unicode
internal-only ones) are not exposed.  See below for more details on
these; there is also a section in the pod listing them, and why they are
not exposed.

Perl now fully supports the Unicode compound-style of using C<=> and C<:>
in writing regular expressions: C<\p{property=value}> and
C<\p{property:value}> (both of which mean the same thing).

Perl now fully supports the Unicode loose matching rules for text
between the braces in C<\p{...}> constructs.  In addition, Perl also allows
underscores between digits of numbers.

All the Unicode-defined synonyms for properties and property values are
now accepted.

C<qr/\X/>, which matches a Unicode logical character, has been expanded to work
better with various Asian languages.  It now is defined as an C<extended
grapheme cluster>.  (See L<http://www.unicode.org/reports/tr29/>).
Anything matched previously that made sense will continue to be matched.  But
in addition:

=over

=item *

C<\X> will now not break apart a C<S<CR LF>> sequence.

=item *

C<\X> will now match a sequence including the C<ZWJ> and C<ZWNJ> characters.

=item *

C<\X> will now always match at least one character, including an initial mark.
Marks generally come after a base character, but it is possible in Unicode to
have them in isolation, and C<\X> will now handle that case, for example at the
beginning of a line or after a C<ZWSP>.  And this is the part where C<\X>
doesn't match the things that it used to that don't make sense.  Formerly, for
example, you could have the nonsensical case of an accented LF.

=item *

C<\X> will now match a (Korean) Hangul syllable sequence, and the Thai and Lao
exception cases.

=back

Otherwise, this change should be transparent for the non-affected languages.

C<\p{...}> matches using the Canonical_Combining_Class property were
completely broken in previous Perls.  This is now fixed.

In previous Perls, the Unicode C<Decomposition_Type=Compat> property and a
Perl extension had the same name, which led to neither matching all the
correct values (with more than 100 mistakes in one, and several thousand
in the other).  The Perl extension has now been renamed to be
C<Decomposition_Type=Noncanonical> (short: C<dt=noncanon>).  It has the same
meaning as was previously intended, namely the union of all the
non-canonical Decomposition types, with Unicode C<Compat> being just one of
those.

C<\p{Uppercase}> and C<\p{Lowercase}> have been brought into line with the
Unicode definitions.  This means they each match a few more characters
than previously.

C<\p{Cntrl}> now matches the same characters as C<\p{Control}>.  This means it
no longer will match Private Use (gc=co), Surrogates (gc=cs), nor Format
(gc=cf) code points.  The Format code points represent the biggest
possible problem.  All but 36 of them are either officially deprecated
or strongly discouraged from being used.  Of those 36, likely the most
widely used are the soft hyphen (U+00AD), and BOM, ZWSP, ZWNJ, WJ, and
similar, plus Bi-directional controls.

C<\p{Alpha}> now matches the same characters as C<\p{Alphabetic}>.  The Perl
definition included a number of things that aren't really alpha (all
marks), while omitting many that were.  As a direct consequence, the
definitions of C<\p{Alnum}> and C<\p{Word}> which depend on Alpha also change.

C<\p{Word}> also now doesn't match certain characters it wasn't supposed
to, such as fractions.

C<\p{Print}> no longer matches the line control characters: Tab, LF, CR,
FF, VT, and NEL.  This brings it in line with the documentation.

C<\p{Decomposition_Type=Canonical}> now includes the Hangul syllables.

The Numeric type property has been extended to include the Unihan
characters.

There is a new Perl extension, the 'Present_In', or simply 'In',
property.  This is an extension of the Unicode Age property, but
C<\p{In=5.0}> matches any code point whose usage has been determined
I<as of> Unicode version 5.0.  The C<\p{Age=5.0}> only matches code points
added in I<precisely> version 5.0.

A number of properties did not have the correct values for unassigned
code points.  This is now fixed.  The affected properties are
Bidi_Class, East_Asian_Width, Joining_Type, Decomposition_Type,
Hangul_Syllable_Type, Numeric_Type, and Line_Break.

The Default_Ignorable_Code_Point, ID_Continue, and ID_Start properties
have been updated to their current Unicode definitions.

Certain properties that are supposed to be Unicode internal-only were
erroneously exposed by previous Perls.  Use of these in regular
expressions will now generate, if enabled, a deprecated warning message.
The properties are: Other_Alphabetic, Other_Default_Ignorable_Code_Point,
Other_Grapheme_Extend, Other_ID_Continue, Other_ID_Start, Other_Lowercase,
Other_Math, and Other_Uppercase.

An installation can now fairly easily change which Unicode properties
Perl understands.  As mentioned above, certain properties are by default
turned off.  These include all the Unihan properties (which should be
accessible via the CPAN module Unicode::Unihan) and any deprecated or
Unicode internal-only property that Perl has never exposed.

The generated files in the C<lib/unicore/To> directory are now more
clearly marked as being stable, directly usable by applications.
New hash entries in them give the format of the normal entries,
which allows for easier machine parsing.  Perl can generate files
in this directory for any property, though most are suppressed.  An
installation can choose to change which get written.  Instructions
are in L<perluniprops>.

=head2 Regular Expressions

U+0FFFF is now a legal character in regular expressions.

=head1 Modules and Pragmata

=head2 Pragmata Changes

=over 4

=item C<constant>

Upgraded from version 1.19 to 1.20.

=item C<diagnostics>

This pragma no longer suppresses C<Use of uninitialized value in range (or flip)> warnings. [perl #71204]

=item C<feature>

Upgraded from 1.13 to 1.14.  Added the C<unicode_strings> feature:

    use feature "unicode_strings";

This pragma turns on Unicode semantics for the case-changing operations
(uc/lc/ucfirst/lcfirst) on strings that don't have the internal UTF-8 flag set,
but that contain single-byte characters between 128 and 255.

=item C<legacy>

The experimental C<legacy> pragma, introduced in 5.11.2, has been removed,
and its functionality replaced by the new feature pragma, C<use feature
"unicode_strings">.

=item C<threads>

Upgraded from version 1.74 to 1.75.

=item C<warnings>

Upgraded from 1.07 to 1.08.  Added new C<warnings::fatal_enabled()> function.

=back

=head2 Updated Modules

=over 4

=item C<Archive::Extract>

Upgraded from version 0.34 to 0.36.

=item C<CPAN>

Upgraded from version 1.94_51 to 1.94_5301, which is 1.94_53 on CPAN
plus some local fixes for bleadperl.

Includes better bzip2 support, improved FirstTime experience with
auto-selection of CPAN mirrors, proper handling of modules removed from the
Perl core, and an updated 'cpan' utility script

=item C<CPANPLUS>

Upgraded from version 0.89_09 to 0.90.

=item C<Encode>

Upgraded from version 2.38 to 2.39.

=item C<ExtUtils::MakeMaker>

Upgraded from version 6.55_02 to 6.56.  Adds new BUILD_REQUIRES key to
indicate build-only prerequisites.  Also adds support for
mingw64 and the new "package NAME VERSION" syntax.

=item C<File::Path>

Upgraded from version 2.08 to 2.08_01.

=item C<Module::Build>

Upgraded from version 0.35_09 to 0.36.  Compared to 0.35, this version has a
new 'installdeps' action, supports the PERL_MB_OPT environment variable, adds a
'share_dir' property for L<File::ShareDir> support, support the "package NAME
VERSION" syntax and has many other enhancements and bug fixes.  The
'passthrough' style of Module::Build::Compat has been deprecated.

=item C<Module::CoreList>

Upgraded from version 2.23 to 2.24.

=item C<POSIX>

Upgraded from version 1.18 to 1.19. Error codes for C<getaddrinfo()> and
C<getnameinfo()> are now available.

=item C<Pod::Simple>

Upgraded from version 3.10 to 3.13.

=item C<Safe>

Upgraded from version 2.19 to 2.20.

=back

=head1 Utility Changes

=over 4

=item F<perlbug>

No longer reports "Message sent" when it hasn't actually sent the message

=back

=head1 Changes to Existing Documentation

The Pod specification (L<perlpodspec>) has been updated to bring the
specification in line with modern usage already supported by most Pod systems.
A parameter string may now follow the format name in a "begin/end" region.
Links to URIs with a text description are now allowed.  The usage of
C<LE<lt>"section"E<gt>> has been marked as deprecated.

L<if.pm|if> has been documented in L<perlfunc/use> as a means to get
conditional loading of modules despite the implicit BEGIN block around C<use>.



=head1 Installation and Configuration Improvements

=head2 Testing improvements

=over 4

=item It's now possible to override C<PERL5OPT> and friends in F<t/TEST>

=back

=head2 Platform Specific Changes

=over 4

=item Win32

=over 4

=item *

Always add a manifest resource to C<perl.exe> to specify the C<trustInfo>
settings for Windows Vista and later.  Without this setting Windows
will treat C<perl.exe> as a legacy application and apply various
heuristics like redirecting access to protected file system areas
(like the "Program Files" folder) to the users "VirtualStore"
instead of generating a proper "permission denied" error.

For VC8 and VC9 this manifest setting is automatically generated by
the compiler/linker (together with the binding information for their
respective runtime libraries); for all other compilers we need to
embed the manifest resource explicitly in the external resource file.

This change also requests the Microsoft Common-Controls version 6.0
(themed controls introduced in Windows XP) via the dependency list
in the assembly manifest.  For VC8 and VC9 this is specified using the
C</manifestdependency> linker commandline option instead.

=back

=item cygwin

=over 4

=item Enable IPv6 support on cygwin 1.7 and newer

=back

=item OpenVMS

=over 4

=item Make -UDEBUGGING the default on VMS for 5.12.0.

Like it has been everywhere else for ages and ages.  Also make
command-line selection of -UDEBUGGING and -DDEBUGGING work in
configure.com; before the only way to turn it off was by saying
no in answer to the interactive question.

=back

=back

=head1 Selected Bug Fixes

=over 4

=item *

Ensure that pp_qr returns a new regexp SV each time. Resolves RT #69852.

Instead of returning a(nother) reference to the (pre-compiled) regexp in the
optree, use reg_temp_copy() to create a copy of it, and return a reference to
that. This resolves issues about Regexp::DESTROY not being called in a timely
fashion (the original bug tracked by RT #69852), as well as bugs related to
blessing regexps, and of assigning to regexps, as described in correspondence
added to the ticket.

It transpires that we also need to undo the SvPVX() sharing when ithreads
cloning a Regexp SV, because mother_re is set to NULL, instead of a cloned
copy of the mother_re. This change might fix bugs with regexps and threads in
certain other situations, but as yet neither tests nor bug reports have
indicated any problems, so it might not actually be an edge case that it's
possible to reach.

=item  *

Several compilation errors and segfaults when perl was built with C<-Dmad> were fixed.

=item *

Fixes for lexer API changes in 5.11.2 which broke NYTProf's savesrc option.

=item *

F<-t> should only return TRUE for file handles connected to a TTY

The Microsoft C version of isatty() returns TRUE for all
character mode devices, including the /dev/null style "nul"
device and printers like "lpt1".

=item *

Fixed a regression caused by commit fafafbaf which caused a panic during
parameter passing [perl #70171]

=item *

On systems which in-place edits without backup files, -i'*' now works as
the documentation says it does [perl #70802]

=item *

Saving and restoring magic flags no longer loses readonly flag.

=item *

The malformed syntax C<grep EXPR LIST> (note the missing comma) no longer
causes abrupt and total failure.

=item *

Regular expressions compiled with C<qr{}> literals properly set C<$'> when
matching again.

=item *

Using named subroutines with C<sort> should no longer lead to bus errors [perl
#71076]

=item *

Numerous bugfixes catch small issues caused by the recently-added Lexer API.

=item *

Smart match against C<@_> sometimes gave false negatives. [perl #71078]

=item *

C<$@> may now be assigned a read-only value (without error or busting the stack).

=item *

C<sort> called recursively from within an active comparison subroutine no
longer causes a bus error if run multiple times. [perl #71076]

=back

=head1 New or Changed Diagnostics

=over 4

=item *

C<split> now warns when called in void context

=item *

C<printf>-style functions called with too few arguments will now issue the
warning C<"Missing argument in %s"> [perl #71000]

=back

=head1 New Tests

Many modules updated from CPAN incorporate new tests.

=over 4

=item t/comp/final_line_num.t

See if line numbers are correct at EOF

=item t/comp/form_scope.t

See if format scoping works

=item t/comp/line_debug.t

See if @{"_<$file"} works

=item t/op/filetest_t.t

See if -t file test works

=item t/op/qr.t

See if qr works

=item t/op/utf8cache.t

Tests malfunctions of utf8 cache

=item t/re/uniprops.t

Test unicode \p{} regex constructs

=back

=head1 Deprecations

The following items are now deprecated.

=over 4

=item Use of "goto" to jump into a construct is deprecated

Using C<goto> to jump from an outer scope into an inner
scope is now deprecated. This rare use case was causing
problems in the implementation of scopes.

=back

=head1 Acknowledgements

Perl 5.11.3 represents approximately one month of development since
Perl 5.11.2 and contains 61407 lines of changes across 396 files
from 40 authors and committers:

Abigail, Alex Davies, Alexandr Ciornii, Andrew Rodland, Andy
Dougherty, Bram, brian d foy, Chip Salzenberg, Chris Williams, Craig
A. Berry, Daniel Frederick Crisman, David Golden, Dennis Kaarsemaker,
Eric Brine, Father Chrysostomos, Gene Sullivan, Gerard Goossen, H.
Merijn Brand, Hugo van der Sanden, Jan Dubois, Jerry D. Hedden,
Jesse Vincent, Jim Cromie, Karl Williamson, Leon Brocard, Max
Maischein, Michael Breen, Moritz Lenz, Nicholas Clark, Rafael
Garcia-Suarez, Reini Urban, Ricardo Signes, Stepan Kasal, Steve
Hay, Steve Peters, Tim Bunce, Tony Cook, Vincent Pit and Zefram.

Many of the changes included in this version originated in the CPAN
modules included in Perl's core. We're grateful to the entire CPAN
community for helping Perl to flourish.

=head1 Reporting Bugs

If you find what you think is a bug, you might check the articles
recently posted to the comp.lang.perl.misc newsgroup and the perl
bug database at http://rt.perl.org/perlbug/ .  There may also be
information at http://www.perl.org/ , the Perl Home Page.

If you believe you have an unreported bug, please run the B<perlbug>
program included with your release.  Be sure to trim your bug down
to a tiny but sufficient test case.  Your bug report, along with the
output of C<perl -V>, will be sent off to perlbug@perl.org to be
analysed by the Perl porting team.

If the bug you are reporting has security implications, which make it
inappropriate to send to a publicly archived mailing list, then please send
it to perl5-security-report@perl.org. This points to a closed subscription
unarchived mailing list, which includes all the core committers, who be able
to help assess the impact of issues, figure out a resolution, and help
co-ordinate the release of patches to mitigate or fix the problem across all
platforms on which Perl is supported. Please only use this address for
security issues in the Perl core, not for modules independently
distributed on CPAN.

=head1 SEE ALSO

The F<Changes> file for an explanation of how to view exhaustive details
on what changed.

The F<INSTALL> file for how to build Perl.

The F<README> file for general stuff.

The F<Artistic> and F<Copying> files for copyright information.

=cut