p5-String-Tokenizer-0.06.txz


Advertisement

Description

p5-String-Tokenizer - Simple string tokenizer

Property Value
Distribution FreeBSD 12
Repository FreeBSD Ports Quarterly amd64
Package filename p5-String-Tokenizer-0.06.txz
Package name p5-String-Tokenizer
Package version 0.06
Package release -
Package architecture amd64
Package type txz
Category perl5 textproc
Homepage https://metacpan.org/release/String-Tokenizer
License GPLv1+, ART10
Maintainer bofh@FreeBSD.org
Download size 13.74 KB
Installed size 28.70 KB
A simple string tokenizer which takes a string and splits it on
whitespace. It also optionally takes a string of characters to use as
delimiters, and returns them with the token set as well. This allows for
splitting the string in many different ways.
This is a very basic tokenizer, so more complex needs should be either
addressed with a custom written tokenizer or post-processing of the output
generated by this module. Basically, this will not fill everyones needs,
but it spans a gap between simple split / /, $string and the other options
that involve much larger and complex modules.
Also note that this is not a lexical analyser. Many people confuse
tokenization with lexical analysis. A tokenizer mearly splits its input
into specific chunks, a lexical analyzer classifies those chunks.
Sometimes these two steps are combined, but not here.
WWW: https://metacpan.org/release/String-Tokenizer

Alternatives

Package Version Architecture Repository
p5-String-Tokenizer-0.06.txz 0.06 i386 FreeBSD Ports Quarterly
p5-String-Tokenizer-0.06.txz 0.06 amd64 FreeBSD Ports Latest
p5-String-Tokenizer-0.06.txz 0.06 i386 FreeBSD Ports Latest
p5-String-Tokenizer - - -

Requires

Name Value
perl5 = 5.28.1_1

Download

Type URL
Mirror pkg.freebsd.org
Binary Package p5-String-Tokenizer-0.06.txz
Source Package textproc/p5-String-Tokenizer

Install Howto

Install p5-String-Tokenizer txz package:

# pkg install p5-String-Tokenizer

See Also

Package Description
p5-String-Trim-0.005.txz Perl extension to trim whitespace from your strings
p5-String-Truncate-1.100602_1.txz Module for when strings are too long to be displayed
p5-String-Urandom-0.16_1.txz Perl extension to convert /dev/urandom to 8-bit chars
p5-String-Util-1.26.txz Perl extension for string processing utilities
p5-Struct-Dumb-0.09.txz Make simple lightweight record-like structures
p5-Sub-Alias-0.03_1.txz Simple subroutine alias
p5-Sub-Current-0.03.txz Get the current subroutine
p5-Sub-Delete-1.00002_1.txz Perl module enabling one to delete subroutines
p5-Sub-Exporter-0.987_1.txz Sophisticated exporter for custom-built routines
p5-Sub-Exporter-ForMethods-0.100052.txz Helper routines for using Sub::Exporter to build methods
p5-Sub-Exporter-GlobExporter-0.005.txz Export shared globs with Sub::Exporter collectors
p5-Sub-Exporter-Lexical-0.092292_1.txz Export lexically-available subs with Sub::Exporter
p5-Sub-Exporter-Progressive-0.001013.txz Only use Sub::Exporter if you need it
p5-Sub-Identify-0.14.txz Retrieve names of code references
p5-Sub-Infix-0.004_1.txz Create a fake infix operator
Advertisement
Advertisement