Package ucar.unidata.util

Interface Tokenizer

public interface Tokenizer

Author:

Unidata

Nested Class Summary

Nested Classes

Modifier and Type	Interface	Description
static class	Tokenizer.EmptyToken	Class EmptyToken
static interface	Tokenizer.Token	Token

Field Summary

Fields

Modifier and Type	Field	Description
static final Tokenizer.Token	TK_EOF	_more_
static final Tokenizer.Token	TK_NONE	Tag interface for Tokens.

Method Summary

Modifier and Type	Method	Description
Tokenizer.Token	nextToken()	_more_

Field Details

TK_NONE

static final Tokenizer.Token TK_NONE

Tag interface for Tokens. Typically, Token implementations extend ByteString. Not all ByteStrings are Tokens tho.

TK_EOF

static final Tokenizer.Token TK_EOF

_more_

Method Details

nextToken

Tokenizer.Token nextToken()
                   throws IOException

_more_

Returns:

_more_

Throws:

IOException