Buf
class Buf : Obj
Buf is used to model a block of bytes with random access. Buf is typically backed by a block of memory, but can also be backed by a file:
- Buf.make: backed by RAM
- File.open: backed by random access file
- File.mmap: backed by memory mapped file
Buf provides an InStream and OutStream to read and write into the buffer using a configurable position accessed via Buf.pos and Buf.seek.
When using an InStream, bytes are read starting at pos where pos is advanced after each read. The end of stream is reached when pos reaches size. When using the OutStream, bytes are written starting at pos with pos advanced after each write. If pos is less then size then the existing bytes are rewritten and size is not advanced, otherwise the buffer is automatically grown and size is advanced as bytes are appended. It is common to write bytes into the buffer using the OutStream, then call Buf.flip to prepare the buffer to be used for reading.
Memory bufs may be made immutable by calling Obj.toImmutable. When a buf is made immutable, the original buffer's data is cleared (to avoid copying the backing array). All write operations on an immutable buf will raise a ReadonlyErr. Reads may be performed by acquiring an InStream via the in method. However, read operations which require a mutable Buf pos will raise ReadonlyErr too, including methods such as seek or read. Use dup to copy an immutable buf back into a mutable buf.
Allocate a byte buffer in RAM with the initial given capacity
Character set for both the OutStream and InStream
Return the total number of bytes in the buffer
Byte order mode for both OutStream and InStream
The number of bytes this buffer can hold without allocating more memory
Convenience for in.readDecimal
Convenience for in.readF4
Convenience for in.readAllStr
Decode the specified hexadecimal string into its binary contents
Convenience for in.readBufFully
Decode the specified Base64 string into its binary contents
Convenience for in.readF8
Convenience for in.readS2
Convenience for out.writeProps Return this
Convenience for in.readS1
Convenience for in.readS4
Trim the capacity such that the underlying storage is optimized for the current size
Return a new buffer containing the bytes in the specified absolute range
Convenience for in.readBuf
Return if the buffer contents are the same size and same bytes
Convenience for out.write Return this
Convenience for in.readS8
Convenience for in.unreadChar Memory backed buffers support a stack based pushback model like IO streams
Return string summary of the buffer
Convenience for out.printLine Return this
Convenience for out.writeI4 Return this
Encode the buffer contents from 0 to size to a Base64 string as defined by MIME RFC 2045
Convenience for in.read
Convenience for out.writeI2 Return this
Get the InStream which reads from this buffer
Encode the buffer contents from 0 to size to a Uri-safe Base64 string as defined by RFC 4648
Convenience for out.writeI8 Return this
Write the specified byte to the end of the buffer using given count
If this Buf is backed by a file, then fsync all changes to the storage device
Return the remaining number of bytes to read
Convenience for in.readProps
Encode the buffer contents from 0 to size into a hexadecimal string
Generate a password based cryptographic key
Create an in-memory File instance for this buffer with the given file URI
Convenience for out.writeUtf Return this
Convenience for out.writeChars Return this
Apply the specified message digest algorithm to this buffer's contents from 0 to size and return the resulting hash
Convenience for in.unread Memory backed buffers support a stack based pushback model like IO streams
Convenience for out.writeF4 Return this
Convenience for out.writeXml Return this
Convenience for in.readAllLines
Convenience for in.readAllBuf
Set the current position to the specified byte offset
Convenience for out.writeBool Return this
Convenience for in.readChar
Get the OutStream which writes to this buffer
Convenience for in.readU4
Generate a random series of bytes
Obsolete call to sync
Convenience for in.readUtf
Compute a cycle redundancy check code using this buffer's contents from 0 to size
Return the current position for the next read or write
Convenience for in.readU2
Get the byte at the specified absolute index
Generate an HMAC message authentication as specified by RFC 2104
Convenience for in.readU1
Convenience for out.writeF8 Return this
If this buffer is backed by a file, then close it
Flip a buffer from write-mode to read-mode
Convenience for in.readBool
Set is used to overwrite the byte at the specified index
Convenience for in.readObj
Convenience for out.writeBuf Return this
Return if more bytes are available to read
Convenience for in.peekChar
Read the buffer for a fresh read by reseting the buffer's pos and size to zero
Return if size() == 0
Convenience for in.readStrToken
Convenience for out.writeObj Return this
Convenience for in.readLine
Convenience for in.peek
Convenience for out.writeChar Return this
Convenience for out.print Return this
Convenience for in.eachLine
Convenience for in.readChars
Buf equality is based on reference equality using the === operator
Convenience for out.writeDecimal Return this
Create a new buffer in memory which deeply clones this buffer
Bool bytesEqual(Buf that)
Return if the buffer contents are the same size and same bytes. Note this could be an extremely expensive call for non-memory buffers.
Int : capacity
The number of bytes this buffer can hold without allocating more memory. Capacity is always greater or equal to size. If adding a large number of bytes, it may be more efficient to manually set capacity. See the trim method to automatically set capacity to size. Throw ArgErr if attempting to set capacity less than size. This method is ignored on a file buffer, and unsupported on mmap.
Charset : charset
Character set for both the OutStream and InStream.
This clear()
Read the buffer for a fresh read by reseting the buffer's pos and size to zero. The buffer's capacity remains the same. Return this.
Bool close()
If this buffer is backed by a file, then close it. If a memory buffer then do nothing. This method is guaranteed to never throw an IOErr. Return true if the buffer was closed successfully or false if closed abnormally.
Int crc(Str algorithm)
Compute a cycle redundancy check code using this buffer's contents from 0 to size. The supported algorithm names:
- "CRC-16": also known as CRC-16-ANSI, CRC-16-IBM; used by USB, ANSI X3.28, and Modbus
- "CRC-32": used by Ethernet, MPEG-2, PKZIP, Gzip, PNG
- "CRC-32-Adler": used by Zlib
Raise ArgErr if algorithm is not available. This method is only supported for memory based buffers.
Buf dup()
Create a new buffer in memory which deeply clones this buffer. The resulting buf is read/write.
Void eachLine(|Str| f)
Convenience for in.eachLine
Endian : endian
Byte order mode for both OutStream and InStream. Default is Endian.big (network byte order).
virtual Bool equals(Obj? that)
Buf equality is based on reference equality using the === operator.
This fill(Int byte, Int times)
Write the specified byte to the end of the buffer using given count.
Examples:
Buf().fill(0xff, 4) => 0xffffffff
This flip()
Flip a buffer from write-mode to read-mode. This method sets total size to current position, and position to 0. Return this.
@Deprecated { msg="Use sync" }
This flush()
Obsolete call to sync. In the future this method may be relaxed to flush only memory buffers, but not force an fsync.
static Buf fromBase64(Str s)
Decode the specified Base64 string into its binary contents. Both MIME RFC 2045 and URI-safe RFC 4648 encodings are supported. Any characters which are not included in the Base64 character set are safely ignored.
Example:
Buf.make.print("Fan").toBase64 => "RmFu"
Buf.fromBase64("RmFu").readAllStr => "Fan"
static Buf fromHex(Str s)
Decode the specified hexadecimal string into its binary contents. Any characters which are not included in the set "0-9, a-f, A-F" are ignored as long as they appear between bytes (hi and lo nibbles must be contiguous).
Example:
Buf.make.print("\r\n").toHex => "0d0a"
Buf.fromHex("0d0a").readAllStr => "\r\n"
@Operator
Int get(Int index)
Get the byte at the specified absolute index. A negative index may be used to access from the end of the buffer. For example get(-1) is translated into get(size-1). This method accesses the buffer absolutely independent of current position. The get method is accessed via the [] shortcut operator. Throw IndexErr if index out of range.
@Operator
Buf getRange(Range range)
Return a new buffer containing the bytes in the specified absolute range. Negative indexes may be used to access from the end of the buf. This method accesses the buffer absolutely independent of current position. This method is accessed via the [] operator. Throw IndexErr if range illegal.
Examples:
buf := Buf.make buf.write(0xaa).write(0xbb).write(0xcc).write(0xdd) buf[0..2] => 0x[aabbcc] buf[3..3] => 0x[dd] buf[-2..-1] => 0x[ccdd] buf[0..<2] => 0x[aabb] buf[1..-2] => 0x[bbcc]
Buf hmac(Str algorithm, Buf key)
Generate an HMAC message authentication as specified by RFC 2104. This buffer is the data input, algorithm specifies the hash digest, and key represents the secret key:
H: specified by algorthim parameter - "MD5" or "SHA1"K: secret key specified by key parameterB: fixed at 64text: this instance
The HMAC is computed using:
ipad = the byte 0x36 repeated B times opad = the byte 0x5C repeated B times H(K XOR opad, H(K XOR ipad, text))
Throw ArgErr if the algorithm is not available. This method is only supported for memory buffers.
Examples:
"hi there".toBuf.hmac("MD5", "secret".toBuf)
InStream in()
Get the InStream which reads from this buffer. This method always returns the same instance. If this buffer is backed by a file, then in.close will not close the file - you must use Buf.close.
Bool isEmpty()
Return if size() == 0.
static new make(Int capacity)
Allocate a byte buffer in RAM with the initial given capacity.
Bool more()
Return if more bytes are available to read: remaining() > 0.
OutStream out()
Get the OutStream which writes to this buffer. This method always returns the same instance. If this buffer is backed by a file, then out.close will not close the file - you must use Buf.close.
static Buf pbk(Str algorithm, Str password, Buf salt, Int iterations, Int keyLen)
Generate a password based cryptographic key. Supported algorithms:
- "PBKDF2WithHmacSHA1"
- "PBKDF2WithHmacSHA256"
Parameters:
- password: secret used to generate resulting cryptographic key
- salt: cryptographic salt
- iterations: number of iterations (the
cterm) - keyLen: desired length of key in bytes (not bits!)
Throw ArgErr if the algorithm is not available. This method is only supported for memory buffers.
Int? peek()
Convenience for in.peek
Int? peekChar()
Convenience for in.peekChar
Int pos()
Return the current position for the next read or write. The position is always between 0 and size. If pos is less than size then future writes will rewrite the existing bytes without growing size. Change the position with seek.
This print(Obj? s)
Convenience for out.print Return this.
This printLine(Obj? obj)
Convenience for out.printLine Return this.
static Buf random(Int size)
Generate a random series of bytes.
Example:
Buf.random(8).toHex => "d548b54989028b90"
Int? read()
Convenience for in.read
Buf readAllBuf()
Convenience for in.readAllBuf
Str[] readAllLines()
Convenience for in.readAllLines
Str readAllStr(Bool normalizeNewlines)
Convenience for in.readAllStr
Bool readBool()
Convenience for in.readBool
Int? readBuf(Buf buf, Int n)
Convenience for in.readBuf
Buf readBufFully(Buf? buf, Int n)
Convenience for in.readBufFully
Int? readChar()
Convenience for in.readChar
Str readChars(Int n)
Convenience for in.readChars
Decimal readDecimal()
Convenience for in.readDecimal
Float readF4()
Convenience for in.readF4
Float readF8()
Convenience for in.readF8
Str? readLine(Int? max)
Convenience for in.readLine
Obj? readObj([Str:Obj]? options)
Convenience for in.readObj
Str:Str readProps()
Convenience for in.readProps
Int readS1()
Convenience for in.readS1
Int readS2()
Convenience for in.readS2
Int readS4()
Convenience for in.readS4
Int readS8()
Convenience for in.readS8
Str? readStrToken(Int? max, |Int->Bool|? c)
Convenience for in.readStrToken
Int readU1()
Convenience for in.readU1
Int readU2()
Convenience for in.readU2
Int readU4()
Convenience for in.readU4
Str readUtf()
Convenience for in.readUtf
Int remaining()
Return the remaining number of bytes to read: size-pos.
This seek(Int pos)
Set the current position to the specified byte offset. A negative index may be used to access from the end of the buffer. For example seek(-1) is translated into seek(size-1). Return this.
@Operator
This set(Int index, Int byte)
Set is used to overwrite the byte at the specified index. A negative index may be used to access an index from the end of the buffer. The set method is accessed via the []= shortcut operator. Return this. Throw IndexErr if index is out of range.
Int : size
Return the total number of bytes in the buffer. If the size is set greater than capacity then the buffer's capacity is automatically grown, otherwise capacity remains the same. Setting size does not actually change any bytes in the buffer. A mmap buffer can never be increased from its initial size.
This sync()
If this Buf is backed by a file, then fsync all changes to the storage device. Throw IOErr on error. Return this.
Str toBase64()
Encode the buffer contents from 0 to size to a Base64 string as defined by MIME RFC 2045. No line breaks are added. This method is only supported by memory-backed buffers; file-backed buffers will throw UnsupportedErr.
Example:
Buf.make.print("Fan").toBase64 => "RmFu"
Buf.fromBase64("RmFu").readAllStr => "Fan"
Str toBase64Uri()
Encode the buffer contents from 0 to size to a Uri-safe Base64 string as defined by RFC 4648. This means + is encoded as -, and / is encoded as _. Additionally, no padding is applied. This method is only supported by memory-backed buffers; file-backed buffers will throw UnsupportedErr.
Example:
Buf.make.print("safe base64~~").toBase64 => "c2FmZSBiYXNlNjR+fg=="
Buf.make.print("safe base64~~").toBase64Uri => "c2FmZSBiYXNlNjR-fg"
Buf toDigest(Str algorithm)
Apply the specified message digest algorithm to this buffer's contents from 0 to size and return the resulting hash. Digests are secure one-way hash functions which input an arbitrary sized buffer and return a fixed sized buffer. Common algorithms include: "MD5", "SHA-1", and "SHA-256"; the full list supported is platform dependent. On the Java VM, the algorithm maps to those available via the java.security.MessageDigest API. Throw ArgErr if the algorithm is not available. This method is unsupported for mmap buffers.
Example:
Buf.make.print("password").print("salt").toDigest("MD5").toHex
=> "b305cadbb3bce54f3aa59c64fec00dea"
File toFile(Uri uri)
Create an in-memory File instance for this buffer with the given file URI. The buffer must be a RAM based buffer which is converted to an immutable buffer via Obj.toImmutable semantics. The current time is used for the file's modified time.
Str toHex()
Encode the buffer contents from 0 to size into a hexadecimal string. This method is unsupported for mmap buffers.
Example:
Buf.make.print("\r\n").toHex => "0d0a"
Buf.fromHex("0d0a").readAllStr => "\r\n"
virtual Str toStr()
Return string summary of the buffer.
This trim()
Trim the capacity such that the underlying storage is optimized for the current size. Return this.
This unread(Int b)
Convenience for in.unread Memory backed buffers support a stack based pushback model like IO streams. File backed buffers will simply rewrite the last position in the file. Return this.
This unreadChar(Int b)
Convenience for in.unreadChar Memory backed buffers support a stack based pushback model like IO streams. File backed buffers will simply rewrite the last position in the file. Return this.
This write(Int byte)
Convenience for out.write Return this.
This writeBool(Bool b)
Convenience for out.writeBool Return this.
This writeBuf(Buf buf, Int n)
Convenience for out.writeBuf Return this.
This writeChar(Int char)
Convenience for out.writeChar Return this.
This writeChars(Str str, Int off, Int len)
Convenience for out.writeChars Return this.
This writeDecimal(Decimal d)
Convenience for out.writeDecimal Return this.
This writeF4(Float r)
Convenience for out.writeF4 Return this.
This writeF8(Float r)
Convenience for out.writeF8 Return this.
This writeI2(Int n)
Convenience for out.writeI2 Return this.
This writeI4(Int n)
Convenience for out.writeI4 Return this.
This writeI8(Int n)
Convenience for out.writeI8 Return this.
This writeObj(Obj? obj, [Str:Obj]? options)
Convenience for out.writeObj Return this.
This writeProps(Str:Str props)
Convenience for out.writeProps Return this.
This writeUtf(Str s)
Convenience for out.writeUtf Return this.
This writeXml(Str s, Int flags)
Convenience for out.writeXml Return this.