dap4.dap4lib

Class D4DataCompiler

java.lang.Object

dap4.dap4lib.D4DataCompiler

public class D4DataCompiler
extends java.lang.Object

Field Summary

Fields

Modifier and Type	Field and Description
protected ChecksumMode	checksummode
static boolean	DEBUG
protected DapDataset	dmr
protected D4DSP	dsp
protected java.util.Map<DapVariable,java.lang.Long>	localchecksummap
protected java.util.Map<DapVariable,java.lang.Long>	remotechecksummap
protected java.nio.ByteOrder	remoteorder
protected DeChunkedInputStream	stream

Constructor Summary

Constructors

Constructor and Description
D4DataCompiler(D4DSP dsp, ChecksumMode checksummode, java.nio.ByteOrder remoteorder) Constructor

Method Summary

Modifier and Type	Method and Description
void	compile() The goal here is to process the serialized databuffer and pull out top-level variable positions in the serialized databuffer.
protected java.lang.Object	compileAtomicVar(DapVariable var) Compile fixed-sized atomic types Storage = []
protected java.lang.Object	compileOpaqueVar(DapVariable var) Read and convert an opaque typed array
java.lang.Object	compileSequence(DapSequence dapseq) Compile a sequence as a set of records.
protected java.lang.Object	compileSequenceArray(DapVariable var) Compile a sequence array.
protected java.lang.Object	compileStringVar(DapVariable var) Read and convert a string typed array
protected java.lang.Object	compileStructure(DapStructure dapstruct) Compile a structure instance.
protected java.lang.Object	compileStructureArray(DapVariable var) Compile a structure array.
protected java.lang.Object	compileVar(DapVariable dapvar) Return a compiled version of the data for this variable.
protected int	computeTypeSize(DapType daptype) Compute the size in databuffer of the serialized form
Array	createArray(DapVariable var, java.lang.Object storage)
protected Array	createAtomicArray(DapVariable var, java.lang.Object storage)
protected Array	createSequenceArray(DapVariable var, java.lang.Object storage) Create an Array object for a DAP4 Sequence.
protected Array	createStructureArray(DapVariable var, java.lang.Object storage)
protected long	extractChecksum()
java.util.Map<DapVariable,java.lang.Long>	getChecksumMap(DapConstants.ChecksumSource src)
protected int	getCount()
protected void	setChecksum(DapConstants.ChecksumSource src, DapVariable dvar, java.lang.Long csum)
protected void	skip(long count)
protected long	walkByteStrings(long[] positions, java.nio.ByteBuffer databuffer)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

DEBUG

public static boolean DEBUG

dmr

protected DapDataset dmr

checksummode

protected ChecksumMode checksummode

remoteorder

protected java.nio.ByteOrder remoteorder

dsp

protected D4DSP dsp

stream

protected DeChunkedInputStream stream

localchecksummap

protected java.util.Map<DapVariable,java.lang.Long> localchecksummap

remotechecksummap

protected java.util.Map<DapVariable,java.lang.Long> remotechecksummap

Constructor Detail

D4DataCompiler

public D4DataCompiler(D4DSP dsp,
                      ChecksumMode checksummode,
                      java.nio.ByteOrder remoteorder)
               throws DapException

Constructor

Parameters:

dsp - the D4DSP

checksummode -

remoteorder -

Throws:

DapException

Method Detail

getChecksumMap

public java.util.Map<DapVariable,java.lang.Long> getChecksumMap(DapConstants.ChecksumSource src)

setChecksum

protected void setChecksum(DapConstants.ChecksumSource src,
                           DapVariable dvar,
                           java.lang.Long csum)

compile

public void compile()
             throws java.io.IOException

The goal here is to process the serialized databuffer and pull out top-level variable positions in the serialized databuffer. In some cases -- String, Sequence, Structure -- significant transforms are applied to the data to make it usable with ucar.ma2.Array.

Throws:

DapException

java.io.IOException

compileVar

protected java.lang.Object compileVar(DapVariable dapvar)
                               throws java.io.IOException

Return a compiled version of the data for this variable. Possible return values are: 1. String - String[] 2. Opaque - Bytebuffer[] 3. Fixed atomic - [] 4. Structure - Object[][nfields] 5. Sequence - Object[][nfields]

Throws:

java.io.IOException

compileAtomicVar

protected java.lang.Object compileAtomicVar(DapVariable var)
                                     throws java.io.IOException

Compile fixed-sized atomic types Storage = []

Parameters:

var -

Returns:

data

Throws:

DapException

java.io.IOException

compileStringVar

protected java.lang.Object compileStringVar(DapVariable var)
                                     throws java.io.IOException

Read and convert a string typed array

Parameters:

var -

Returns:

cursor

Throws:

DapException

java.io.IOException

compileOpaqueVar

protected java.lang.Object compileOpaqueVar(DapVariable var)
                                     throws java.io.IOException

Read and convert an opaque typed array

Parameters:

var -

Returns:

cursor

Throws:

DapException

java.io.IOException

compileStructureArray

protected java.lang.Object compileStructureArray(DapVariable var)
                                          throws java.io.IOException

Compile a structure array. Since we are using ArrayStructureMA, we need to capture Our storage is Object[dimproduct]; this will be converted properly when the D4Cursor Array is created.

Parameters:

var - the template

Returns:

a StructureData[dimproduct] for the data for this struct.

Throws:

DapException

java.io.IOException

compileStructure

protected java.lang.Object compileStructure(DapStructure dapstruct)
                                     throws java.io.IOException

Compile a structure instance. Storage is Object[dapstruct.getFields().size()];

Parameters:

dapstruct - The template

Returns:

A DataStructure for the databuffer for this struct.

Throws:

DapException

java.io.IOException

compileSequenceArray

protected java.lang.Object compileSequenceArray(DapVariable var)
                                         throws java.io.IOException

Compile a sequence array. Our storage is Object[dimproduct]

Parameters:

var - the template

Returns:

Object[recordcount]

Throws:

DapException

java.io.IOException

compileSequence

public java.lang.Object compileSequence(DapSequence dapseq)
                                 throws java.io.IOException

Compile a sequence as a set of records. Our storage is Object[] where |storage| == nrecords

Parameters:

dapseq -

Returns:

sequence

Throws:

DapException

java.io.IOException

extractChecksum

protected long extractChecksum()
                        throws java.io.IOException

Throws:

java.io.IOException

skip

protected void skip(long count)
             throws java.io.IOException

Throws:

java.io.IOException

getCount

protected int getCount()
                throws java.io.IOException

Throws:

java.io.IOException

computeTypeSize

protected int computeTypeSize(DapType daptype)

Compute the size in databuffer of the serialized form

Parameters:

daptype -

Returns:

type's serialized form size

walkByteStrings

protected long walkByteStrings(long[] positions,
                               java.nio.ByteBuffer databuffer)
                        throws java.io.IOException

Throws:

java.io.IOException

createArray

public Array createArray(DapVariable var,
                         java.lang.Object storage)

createAtomicArray

protected Array createAtomicArray(DapVariable var,
                                  java.lang.Object storage)

createStructureArray

protected Array createStructureArray(DapVariable var,
                                     java.lang.Object storage)

createSequenceArray

protected Array createSequenceArray(DapVariable var,
                                    java.lang.Object storage)

Create an Array object for a DAP4 Sequence. Unfortunately, the whole CDM Sequence/VLEN mechanism is completely hosed, with no hope of a simple fix. It appears that the only thing we can do is support scalar sequences. However in useless hope, the code is written as if arrays of sequences can be supported.

Parameters:

var -

storage -

Returns: