pcre2posix.html 16 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356
  1. <html>
  2. <head>
  3. <title>pcre2posix specification</title>
  4. </head>
  5. <body bgcolor="#FFFFFF" text="#00005A" link="#0066FF" alink="#3399FF" vlink="#2222BB">
  6. <h1>pcre2posix man page</h1>
  7. <p>
  8. Return to the <a href="index.html">PCRE2 index page</a>.
  9. </p>
  10. <p>
  11. This page is part of the PCRE2 HTML documentation. It was generated
  12. automatically from the original man page. If there is any nonsense in it,
  13. please consult the man page, in case the conversion went wrong.
  14. <br>
  15. <ul>
  16. <li><a name="TOC1" href="#SEC1">SYNOPSIS</a>
  17. <li><a name="TOC2" href="#SEC2">DESCRIPTION</a>
  18. <li><a name="TOC3" href="#SEC3">USING THE POSIX FUNCTIONS</a>
  19. <li><a name="TOC4" href="#SEC4">COMPILING A PATTERN</a>
  20. <li><a name="TOC5" href="#SEC5">MATCHING NEWLINE CHARACTERS</a>
  21. <li><a name="TOC6" href="#SEC6">MATCHING A PATTERN</a>
  22. <li><a name="TOC7" href="#SEC7">ERROR MESSAGES</a>
  23. <li><a name="TOC8" href="#SEC8">MEMORY USAGE</a>
  24. <li><a name="TOC9" href="#SEC9">AUTHOR</a>
  25. <li><a name="TOC10" href="#SEC10">REVISION</a>
  26. </ul>
  27. <br><a name="SEC1" href="#TOC1">SYNOPSIS</a><br>
  28. <P>
  29. <b>#include &#60;pcre2posix.h&#62;</b>
  30. </P>
  31. <P>
  32. <b>int pcre2_regcomp(regex_t *<i>preg</i>, const char *<i>pattern</i>,</b>
  33. <b> int <i>cflags</i>);</b>
  34. <br>
  35. <br>
  36. <b>int pcre2_regexec(const regex_t *<i>preg</i>, const char *<i>string</i>,</b>
  37. <b> size_t <i>nmatch</i>, regmatch_t <i>pmatch</i>[], int <i>eflags</i>);</b>
  38. <br>
  39. <br>
  40. <b>size_t pcre2_regerror(int <i>errcode</i>, const regex_t *<i>preg</i>,</b>
  41. <b> char *<i>errbuf</i>, size_t <i>errbuf_size</i>);</b>
  42. <br>
  43. <br>
  44. <b>void pcre2_regfree(regex_t *<i>preg</i>);</b>
  45. </P>
  46. <br><a name="SEC2" href="#TOC1">DESCRIPTION</a><br>
  47. <P>
  48. This set of functions provides a POSIX-style API for the PCRE2 regular
  49. expression 8-bit library. There are no POSIX-style wrappers for PCRE2's 16-bit
  50. and 32-bit libraries. See the
  51. <a href="pcre2api.html"><b>pcre2api</b></a>
  52. documentation for a description of PCRE2's native API, which contains much
  53. additional functionality.
  54. </P>
  55. <P>
  56. The functions described here are wrapper functions that ultimately call the
  57. PCRE2 native API. Their prototypes are defined in the <b>pcre2posix.h</b> header
  58. file, and they all have unique names starting with <b>pcre2_</b>. However, the
  59. <b>pcre2posix.h</b> header also contains macro definitions that convert the
  60. standard POSIX names such <b>regcomp()</b> into <b>pcre2_regcomp()</b> etc. This
  61. means that a program can use the usual POSIX names without running the risk of
  62. accidentally linking with POSIX functions from a different library.
  63. </P>
  64. <P>
  65. On Unix-like systems the PCRE2 POSIX library is called <b>libpcre2-posix</b>, so
  66. can be accessed by adding <b>-lpcre2-posix</b> to the command for linking an
  67. application. Because the POSIX functions call the native ones, it is also
  68. necessary to add <b>-lpcre2-8</b>.
  69. </P>
  70. <P>
  71. Although they were not defined as protypes in <b>pcre2posix.h</b>, releases
  72. 10.33 to 10.36 of the library contained functions with the POSIX names
  73. <b>regcomp()</b> etc. These simply passed their arguments to the PCRE2
  74. functions. These functions were provided for backwards compatibility with
  75. earlier versions of PCRE2, which had only POSIX names. However, this has proved
  76. troublesome in situations where a program links with several libraries, some of
  77. which use PCRE2's POSIX interface while others use the real POSIX functions.
  78. For this reason, the POSIX names have been removed since release 10.37.
  79. </P>
  80. <P>
  81. Calling the header file <b>pcre2posix.h</b> avoids any conflict with other POSIX
  82. libraries. It can, of course, be renamed or aliased as <b>regex.h</b>, which is
  83. the "correct" name, if there is no clash. It provides two structure types,
  84. <i>regex_t</i> for compiled internal forms, and <i>regmatch_t</i> for returning
  85. captured substrings. It also defines some constants whose names start with
  86. "REG_"; these are used for setting options and identifying error codes.
  87. </P>
  88. <br><a name="SEC3" href="#TOC1">USING THE POSIX FUNCTIONS</a><br>
  89. <P>
  90. Those POSIX option bits that can reasonably be mapped to PCRE2 native options
  91. have been implemented. In addition, the option REG_EXTENDED is defined with the
  92. value zero. This has no effect, but since programs that are written to the
  93. POSIX interface often use it, this makes it easier to slot in PCRE2 as a
  94. replacement library. Other POSIX options are not even defined.
  95. </P>
  96. <P>
  97. There are also some options that are not defined by POSIX. These have been
  98. added at the request of users who want to make use of certain PCRE2-specific
  99. features via the POSIX calling interface or to add BSD or GNU functionality.
  100. </P>
  101. <P>
  102. When PCRE2 is called via these functions, it is only the API that is POSIX-like
  103. in style. The syntax and semantics of the regular expressions themselves are
  104. still those of Perl, subject to the setting of various PCRE2 options, as
  105. described below. "POSIX-like in style" means that the API approximates to the
  106. POSIX definition; it is not fully POSIX-compatible, and in multi-unit encoding
  107. domains it is probably even less compatible.
  108. </P>
  109. <P>
  110. The descriptions below use the actual names of the functions, but, as described
  111. above, the standard POSIX names (without the <b>pcre2_</b> prefix) may also be
  112. used.
  113. </P>
  114. <br><a name="SEC4" href="#TOC1">COMPILING A PATTERN</a><br>
  115. <P>
  116. The function <b>pcre2_regcomp()</b> is called to compile a pattern into an
  117. internal form. By default, the pattern is a C string terminated by a binary
  118. zero (but see REG_PEND below). The <i>preg</i> argument is a pointer to a
  119. <b>regex_t</b> structure that is used as a base for storing information about
  120. the compiled regular expression. (It is also used for input when REG_PEND is
  121. set.)
  122. </P>
  123. <P>
  124. The argument <i>cflags</i> is either zero, or contains one or more of the bits
  125. defined by the following macros:
  126. <pre>
  127. REG_DOTALL
  128. </pre>
  129. The PCRE2_DOTALL option is set when the regular expression is passed for
  130. compilation to the native function. Note that REG_DOTALL is not part of the
  131. POSIX standard.
  132. <pre>
  133. REG_ICASE
  134. </pre>
  135. The PCRE2_CASELESS option is set when the regular expression is passed for
  136. compilation to the native function.
  137. <pre>
  138. REG_NEWLINE
  139. </pre>
  140. The PCRE2_MULTILINE option is set when the regular expression is passed for
  141. compilation to the native function. Note that this does <i>not</i> mimic the
  142. defined POSIX behaviour for REG_NEWLINE (see the following section).
  143. <pre>
  144. REG_NOSPEC
  145. </pre>
  146. The PCRE2_LITERAL option is set when the regular expression is passed for
  147. compilation to the native function. This disables all meta characters in the
  148. pattern, causing it to be treated as a literal string. The only other options
  149. that are allowed with REG_NOSPEC are REG_ICASE, REG_NOSUB, REG_PEND, and
  150. REG_UTF. Note that REG_NOSPEC is not part of the POSIX standard.
  151. <pre>
  152. REG_NOSUB
  153. </pre>
  154. When a pattern that is compiled with this flag is passed to
  155. <b>pcre2_regexec()</b> for matching, the <i>nmatch</i> and <i>pmatch</i> arguments
  156. are ignored, and no captured strings are returned. Versions of the PCRE library
  157. prior to 10.22 used to set the PCRE2_NO_AUTO_CAPTURE compile option, but this
  158. no longer happens because it disables the use of backreferences.
  159. <pre>
  160. REG_PEND
  161. </pre>
  162. If this option is set, the <b>reg_endp</b> field in the <i>preg</i> structure
  163. (which has the type const char *) must be set to point to the character beyond
  164. the end of the pattern before calling <b>pcre2_regcomp()</b>. The pattern itself
  165. may now contain binary zeros, which are treated as data characters. Without
  166. REG_PEND, a binary zero terminates the pattern and the <b>re_endp</b> field is
  167. ignored. This is a GNU extension to the POSIX standard and should be used with
  168. caution in software intended to be portable to other systems.
  169. <pre>
  170. REG_UCP
  171. </pre>
  172. The PCRE2_UCP option is set when the regular expression is passed for
  173. compilation to the native function. This causes PCRE2 to use Unicode properties
  174. when matchine \d, \w, etc., instead of just recognizing ASCII values. Note
  175. that REG_UCP is not part of the POSIX standard.
  176. <pre>
  177. REG_UNGREEDY
  178. </pre>
  179. The PCRE2_UNGREEDY option is set when the regular expression is passed for
  180. compilation to the native function. Note that REG_UNGREEDY is not part of the
  181. POSIX standard.
  182. <pre>
  183. REG_UTF
  184. </pre>
  185. The PCRE2_UTF option is set when the regular expression is passed for
  186. compilation to the native function. This causes the pattern itself and all data
  187. strings used for matching it to be treated as UTF-8 strings. Note that REG_UTF
  188. is not part of the POSIX standard.
  189. </P>
  190. <P>
  191. In the absence of these flags, no options are passed to the native function.
  192. This means the the regex is compiled with PCRE2 default semantics. In
  193. particular, the way it handles newline characters in the subject string is the
  194. Perl way, not the POSIX way. Note that setting PCRE2_MULTILINE has only
  195. <i>some</i> of the effects specified for REG_NEWLINE. It does not affect the way
  196. newlines are matched by the dot metacharacter (they are not) or by a negative
  197. class such as [^a] (they are).
  198. </P>
  199. <P>
  200. The yield of <b>pcre2_regcomp()</b> is zero on success, and non-zero otherwise.
  201. The <i>preg</i> structure is filled in on success, and one other member of the
  202. structure (as well as <i>re_endp</i>) is public: <i>re_nsub</i> contains the
  203. number of capturing subpatterns in the regular expression. Various error codes
  204. are defined in the header file.
  205. </P>
  206. <P>
  207. NOTE: If the yield of <b>pcre2_regcomp()</b> is non-zero, you must not attempt
  208. to use the contents of the <i>preg</i> structure. If, for example, you pass it
  209. to <b>pcre2_regexec()</b>, the result is undefined and your program is likely to
  210. crash.
  211. </P>
  212. <br><a name="SEC5" href="#TOC1">MATCHING NEWLINE CHARACTERS</a><br>
  213. <P>
  214. This area is not simple, because POSIX and Perl take different views of things.
  215. It is not possible to get PCRE2 to obey POSIX semantics, but then PCRE2 was
  216. never intended to be a POSIX engine. The following table lists the different
  217. possibilities for matching newline characters in Perl and PCRE2:
  218. <pre>
  219. Default Change with
  220. . matches newline no PCRE2_DOTALL
  221. newline matches [^a] yes not changeable
  222. $ matches \n at end yes PCRE2_DOLLAR_ENDONLY
  223. $ matches \n in middle no PCRE2_MULTILINE
  224. ^ matches \n in middle no PCRE2_MULTILINE
  225. </pre>
  226. This is the equivalent table for a POSIX-compatible pattern matcher:
  227. <pre>
  228. Default Change with
  229. . matches newline yes REG_NEWLINE
  230. newline matches [^a] yes REG_NEWLINE
  231. $ matches \n at end no REG_NEWLINE
  232. $ matches \n in middle no REG_NEWLINE
  233. ^ matches \n in middle no REG_NEWLINE
  234. </pre>
  235. This behaviour is not what happens when PCRE2 is called via its POSIX
  236. API. By default, PCRE2's behaviour is the same as Perl's, except that there is
  237. no equivalent for PCRE2_DOLLAR_ENDONLY in Perl. In both PCRE2 and Perl, there
  238. is no way to stop newline from matching [^a].
  239. </P>
  240. <P>
  241. Default POSIX newline handling can be obtained by setting PCRE2_DOTALL and
  242. PCRE2_DOLLAR_ENDONLY when calling <b>pcre2_compile()</b> directly, but there is
  243. no way to make PCRE2 behave exactly as for the REG_NEWLINE action. When using
  244. the POSIX API, passing REG_NEWLINE to PCRE2's <b>pcre2_regcomp()</b> function
  245. causes PCRE2_MULTILINE to be passed to <b>pcre2_compile()</b>, and REG_DOTALL
  246. passes PCRE2_DOTALL. There is no way to pass PCRE2_DOLLAR_ENDONLY.
  247. </P>
  248. <br><a name="SEC6" href="#TOC1">MATCHING A PATTERN</a><br>
  249. <P>
  250. The function <b>pcre2_regexec()</b> is called to match a compiled pattern
  251. <i>preg</i> against a given <i>string</i>, which is by default terminated by a
  252. zero byte (but see REG_STARTEND below), subject to the options in <i>eflags</i>.
  253. These can be:
  254. <pre>
  255. REG_NOTBOL
  256. </pre>
  257. The PCRE2_NOTBOL option is set when calling the underlying PCRE2 matching
  258. function.
  259. <pre>
  260. REG_NOTEMPTY
  261. </pre>
  262. The PCRE2_NOTEMPTY option is set when calling the underlying PCRE2 matching
  263. function. Note that REG_NOTEMPTY is not part of the POSIX standard. However,
  264. setting this option can give more POSIX-like behaviour in some situations.
  265. <pre>
  266. REG_NOTEOL
  267. </pre>
  268. The PCRE2_NOTEOL option is set when calling the underlying PCRE2 matching
  269. function.
  270. <pre>
  271. REG_STARTEND
  272. </pre>
  273. When this option is set, the subject string starts at <i>string</i> +
  274. <i>pmatch[0].rm_so</i> and ends at <i>string</i> + <i>pmatch[0].rm_eo</i>, which
  275. should point to the first character beyond the string. There may be binary
  276. zeros within the subject string, and indeed, using REG_STARTEND is the only
  277. way to pass a subject string that contains a binary zero.
  278. </P>
  279. <P>
  280. Whatever the value of <i>pmatch[0].rm_so</i>, the offsets of the matched string
  281. and any captured substrings are still given relative to the start of
  282. <i>string</i> itself. (Before PCRE2 release 10.30 these were given relative to
  283. <i>string</i> + <i>pmatch[0].rm_so</i>, but this differs from other
  284. implementations.)
  285. </P>
  286. <P>
  287. This is a BSD extension, compatible with but not specified by IEEE Standard
  288. 1003.2 (POSIX.2), and should be used with caution in software intended to be
  289. portable to other systems. Note that a non-zero <i>rm_so</i> does not imply
  290. REG_NOTBOL; REG_STARTEND affects only the location and length of the string,
  291. not how it is matched. Setting REG_STARTEND and passing <i>pmatch</i> as NULL
  292. are mutually exclusive; the error REG_INVARG is returned.
  293. </P>
  294. <P>
  295. If the pattern was compiled with the REG_NOSUB flag, no data about any matched
  296. strings is returned. The <i>nmatch</i> and <i>pmatch</i> arguments of
  297. <b>pcre2_regexec()</b> are ignored (except possibly as input for REG_STARTEND).
  298. </P>
  299. <P>
  300. The value of <i>nmatch</i> may be zero, and the value <i>pmatch</i> may be NULL
  301. (unless REG_STARTEND is set); in both these cases no data about any matched
  302. strings is returned.
  303. </P>
  304. <P>
  305. Otherwise, the portion of the string that was matched, and also any captured
  306. substrings, are returned via the <i>pmatch</i> argument, which points to an
  307. array of <i>nmatch</i> structures of type <i>regmatch_t</i>, containing the
  308. members <i>rm_so</i> and <i>rm_eo</i>. These contain the byte offset to the first
  309. character of each substring and the offset to the first character after the end
  310. of each substring, respectively. The 0th element of the vector relates to the
  311. entire portion of <i>string</i> that was matched; subsequent elements relate to
  312. the capturing subpatterns of the regular expression. Unused entries in the
  313. array have both structure members set to -1.
  314. </P>
  315. <P>
  316. A successful match yields a zero return; various error codes are defined in the
  317. header file, of which REG_NOMATCH is the "expected" failure code.
  318. </P>
  319. <br><a name="SEC7" href="#TOC1">ERROR MESSAGES</a><br>
  320. <P>
  321. The <b>pcre2_regerror()</b> function maps a non-zero errorcode from either
  322. <b>pcre2_regcomp()</b> or <b>pcre2_regexec()</b> to a printable message. If
  323. <i>preg</i> is not NULL, the error should have arisen from the use of that
  324. structure. A message terminated by a binary zero is placed in <i>errbuf</i>. If
  325. the buffer is too short, only the first <i>errbuf_size</i> - 1 characters of the
  326. error message are used. The yield of the function is the size of buffer needed
  327. to hold the whole message, including the terminating zero. This value is
  328. greater than <i>errbuf_size</i> if the message was truncated.
  329. </P>
  330. <br><a name="SEC8" href="#TOC1">MEMORY USAGE</a><br>
  331. <P>
  332. Compiling a regular expression causes memory to be allocated and associated
  333. with the <i>preg</i> structure. The function <b>pcre2_regfree()</b> frees all
  334. such memory, after which <i>preg</i> may no longer be used as a compiled
  335. expression.
  336. </P>
  337. <br><a name="SEC9" href="#TOC1">AUTHOR</a><br>
  338. <P>
  339. Philip Hazel
  340. <br>
  341. University Computing Service
  342. <br>
  343. Cambridge, England.
  344. <br>
  345. </P>
  346. <br><a name="SEC10" href="#TOC1">REVISION</a><br>
  347. <P>
  348. Last updated: 26 April 2021
  349. <br>
  350. Copyright &copy; 1997-2021 University of Cambridge.
  351. <br>
  352. <p>
  353. Return to the <a href="index.html">PCRE2 index page</a>.
  354. </p>