StringTokenizer should return one token per delimiter by default to match Java

Description

When StringTokenizer is used with returnDelims set to true, it is returning one
token per run of delimiters. The API docs (like Java's API docs) say that it
returns one token per delimiter. This is the Java StringTokenizer behavior.

This is a compatibility issue for people migrating from Java's StringTokenizer
to ours. We should adhere to our docs and Java's behavior.

In order to support existing users we can continue to support the existing
behavior by adding new constructors. This will be a compatibility change for
them and they'd have to migrate to the new APIs.

Activity

Show:
TracBot
June 30, 2018, 11:29 PM
Trac Comment by auditor—1970-01-01T01:24:42.000Z
  • Wed Feb 15 17:47:16 2006 grhoten moved from incoming to strings

  • Fri May 5 11:35:15 2006 dougfelt changed notes2: review: "" to "ram",

  • Mon Aug 7 15:30:39 2006 ram moved from strings to fixed

  • Sun Oct 22 07:35:29 2006 grhoten moved from fixed to closed

Fixed

Assignee

Douglas Felt

Reporter

TracBot

Components

Labels

None

Reviewer

None

Priority

major

Time Needed

None

Fix versions