Thu Mar 31 18:38:13 UTC 2011 Dale Wilson <[email protected]>

* src/Common/Logger.h:

Change definition of log levels from enum to unsigned short.

That way the enum values are sure to match the time of the arguments.

* src/Communication/PCapReader.cpp:

Fix a bug encountered when reading 64 bit headers on a 32 bit system.

Addresses Issue #80

Thu Mar 31 14:21:09 UTC 2011 Dale Wilson <[email protected]>

* src/Codecs/DataSource.h:

add optimization to allow accessing multiple bytes

with one call as long as they are contiguous in the buffer.

* src/Codecs/FieldInstruction.h:

Improved error messages to indicate the type of field being decoded.

Work-in-progress (disabled for now): specilization of the decode*Integer methods

for specific integer sizes. Not working, yet, and needs profiling after

it does work to be sure it actually helps.

* src/Codecs/SynchronousDecoder.h:

* src/Examples/PerformanceTest/PerformanceTest.h:

* src/Examples/PerformanceTest/PerformanceTest.cpp:

Add the ability to handle messages with non-FAST headers

* src/Common/Exceptions.h:

Add new exception to be thrown when an internal logic error is detected

* src/Communication/AsioService.h:

* src/Communication/AsioService.cpp:

Log messages via the logger interface rather than std::err

* src/Communication/AsynchReceiver.h:

* src/Communication/BufferReceiver.h:

* src/Communication/PCapFileReceiver.h:

* src/Communication/RawFileReceiver.h:

* src/Communication/Receiver.h:

Add method to reset the asio IOService

However, it is usually better to delete the old object an create a new one.

Beware shared IOServices when you use the reset method.

Wed Mar 30 16:05:08 UTC 2011 Dale Wilson <[email protected]>

* src/Application/DecoderConnection.cpp:

Accept FAST data from std::cin. This does not work on

Windows because the data is binary.

Any application using Application::DataConnection can

invoke this by using a file name of "cin" for the FAST data.

Tue Feb 22 15:16:29 UTC 2011 Dale Wilson <[email protected]>

* src/Communication/PCapReader.cpp:

Issue #69. The PCapReader was including the packet checksum in the size of the payload.

Mon Feb 14 21:40:13 UTC 2011 Dale Wilson <[email protected]>

* src/Application/DecoderConfiguration.h:

* src/Application/DecoderConnection.cpp:

Uninitialized variables and duplicated (copy/paste) code.

Issue #77

Mon Feb 14 20:31:54 UTC 2011 Dale Wilson <[email protected]>

* src/Codecs/DataSource.cpp:

* src/Codecs/FastEncodedHeaderAnalyzer.cpp:

* src/Codecs/FieldInstruction.h:

* src/Codecs/FieldInstruction.cpp:

* src/Codecs/FieldInstructionBlob.cpp:

* src/Codecs/FieldInstructionDecimal.cpp:

* src/Codecs/FieldInstructionInteger.h:

* src/Codecs/FixedSizeHeaderAnalyzer.cpp:

* src/Codecs/PresenceMap.cpp:

* src/Codecs/SynchronousDecoder.h:

* src/Messages/SingleValueBuilder.h:

Eliminate some build warnings on Linux.

Fri Jan 7 19:19:32 UTC 2011 Dale Wilson <[email protected]>

* src/Codecs/DataSourceBufferedStream.h:

* src/Examples/PerformanceTest/PerformanceTest.cpp:

Remove obsolete comments

* src/Examples/Examples/CommandArgParser.cpp:

Remove leftover debuging statements

Mon Dec 27 17:14:38 UTC 2010 Adam Mitz <[email protected]>

* QuickFAST.mwc:

The keyword "specific" is now treated as a keyword in mwc files as

well as mpc files. Changed the name of the C# scope to avoid this

naming conflict. The scope's name is otherwise insignificant.

Thu Dec 9 20:50:00 UTC 2010 Dale Wilson <[email protected]>

* src/Common/Version.h:

set preliminary 1.3.1

* src/Examples/Examples/CommandArgParser.h:

* src/Examples/Examples/CommandArgParser.cpp:

The -options command line option reads additional options from a file.

* src/Examples/Examples/ConsoleLock.h:

* src/Examples/Examples/ConsoleLock.cpp:

"Global" lock to avoid mixing console writes.

* src/Application/DecoderConfiguration.h:

* src/Examples/Examples/MessageInterpreter.cpp:

* src/Examples/InterpretApplication/InterpretApplication.h:

* src/Examples/InterpretApplication/InterpretApplication.cpp:

Support multiple connections.

Thu Dec 2 16:03:16 UTC 2010 Dale Wilson <[email protected]>

* src/Common/Version.h:

Update version number for V1.3.0 release

Tue Nov 30 20:10:49 UTC 2010 Dale Wilson <[email protected]>

* src/DotNetTests:

* src/DotNetTests/.svnignore:

* src/DotNetTests/DecimalTests.cs:

* src/DotNetTests/EncodeDecodeTests.cs:

* src/DotNetTests/FieldTests.cs:

* src/DotNetTests/MessageTests.cs:

* src/DotNetTests/PrerequisitsTests.cs:

* src/DotNetTests/Properties:

* src/DotNetTests/Properties/AssemblyInfo.cs:

* src/DotNetTests/QuickFASTDotNetTests.mpc:

Remove .NET tests. They need to be completely rewritten.

Tue Nov 30 20:07:43 UTC 2010 Dale Wilson <[email protected]>

* QuickFAST.mwc:

* QuickFastDotNetTests.nunit:

* src/DotNetTests:

Remove .NET tests. They need to be completely rewritten.

Tue Nov 30 15:23:19 UTC 2010 Dale Wilson <[email protected]>

* src/Application/DecoderConfiguration.h:

* src/Application/DecoderConnection.h:

* src/Application/DecoderConnection.cpp:

* src/Communication/AsioService.h:

* src/Communication/AsioService_fwd.h

* src/Examples/InterpretApplication/InterpretApplication.cpp:

Add the ability to configure a private IOService at the Application

level and in the InterpretApplication example program.

A connection with a private I/O service is independent of

any other connection in the process. In particular this is needed

if a connection will be stopped and/or restarted while other

connections continue to operate.

The downside to this option is that independent connections cannot

share threads so more threads may be needed to service the connections.

Wed Nov 24 15:08:23 UTC 2010 Dale Wilson <[email protected]>

* setup.cmd:

Handle "Program Files (x86)" [shudder]

* src/Application/DecoderConfiguration.h:

* src/Application/DecoderConnection.h:

* src/Application/DecoderConnection.cpp:

* src/Codecs/HeaderAnalyzer.h:

* src/Codecs/MessagePerPacketAssembler.h:

* src/Codecs/MessagePerPacketAssembler.cpp:

* src/Codecs/MulticastDecoder.h:

* src/Codecs/MulticastDecoder.cpp:

* src/Examples/InterpretApplication/InterpretApplication.cpp:

Support both packet headers (for UDP/MULTICAST) and message

headers (for everyone) independently.

This addresses Issue #71.

Tue Nov 23 19:11:31 UTC 2010 Dale Wilson <[email protected]>

* src/Application/DNDecoderConnectionImpl.cpp:

Remove unnecessary includes

* src/Tests/testXMLTemplateParser.cpp:

Test length field instruction for byteVector - s/b ignored.

Thu Oct 21 19:10:46 UTC 2010 Dale Wilson <[email protected]>

* src/Application/DNDecoderConnectionImpl.h:

* src/Application/DNDecoderConnectionImpl.cpp:

* src/Application/DNDecoderConnectionImpl_fwd.h:

* src/Application/DecoderConfiguration.h:

* src/Application/DecoderConfiguration_fwd.h:

* src/Application/DecoderConnection.cpp:

* src/Codecs/DataSource.h:

* src/Codecs/DataSource.cpp:

* src/DotNet/DNDecoderConnection.h:

* src/DotNet/DNDecoderConnection.cpp:

* src/DotNet/QuickFASTDotNetPch.h:

* src/DotNetExamples/PerformanceTestDotNet/PerformanceTestDotNet.cs:

Conflict between boost 1.41+ and .NET: Boost::threads is using inline assembly to implement

future thread synchronization. Managed C++ hates inline assembly.

This changes widens the DMZ between .NET and the real world by adding an *impl layer to

DNDecoderConnection.

Wed Oct 13 20:09:11 UTC 2010 Dale Wilson <[email protected]>

* src/Examples/InterpretApplication/InterpretApplication.cpp:

Fix an error in argument parsing. It was comparing pointers (argv[1]) rather than strings.

Tue Oct 12 19:38:57 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/PresenceMap.h:

* src/Codecs/PresenceMap.cpp:

Add the ability to parse from a buffer rather than (in addition to) a data source.

* src/Common/Constants.h:

Define a couple of the ASCII control characters (used by some exchanges)

* src/Examples/Examples/ExamplesPch.h:

include <string.h>

Tue Oct 5 21:12:28 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/Encoder.cpp:

Error in destination buffer management could lead to corrupted messages.

Tue Oct 5 20:37:22 UTC 2010 Dale Wilson <[email protected]>

* src/Tests/testNestedSequences.cpp:

Add new unit test for Issue #68.

It passes. Issue was already fixed.

Tue Oct 5 18:46:28 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/FieldInstructionBlob.h:

* src/Codecs/FieldInstructionBlob.cpp:

* src/Codecs/FieldInstructionGroup.cpp:

* src/Codecs/SchemaElement.h:

Ignore <length> in <byteVector>

* src/Codecs/TemplateRegistry.h:

* src/Codecs/XMLTemplateParser.h:

Forbid copy constructor and assignment.

* src/Common/QuickFASTPch.h:

Turn off boost linker diagnostics

Tue Oct 5 15:34:40 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/DataSource.cpp:

* src/Tests/testCommon.cpp:

Avoid compiler warnings

* src/Codecs/DataSourceBufferedBlockedStream.cpp:

Invalid comparison operator.

* src/Codecs/FieldInstructionGroup.cpp:

Groups with no typeref inherit the type from their parent. This means

in the decoder they are merged into the parent object (although this

behavior may vary in custom implementations of ValueMessageBuilder.)

This change reserves space for the merged fields.

* src/Codecs/FieldInstructionTemplateRef.h:

* src/Codecs/FieldInstructionTemplateRef.cpp:

Correct the calculation of the number of fields to be included

via a static template reference.

* src/Codecs/SegmentBody.cpp:

Fix an assumption that the number of field instructions in a segment

matched the number of fields to be including in the resulting field set.

* src/Codecs/StreamingAssembler.cpp:

* src/Communication/AsynchReceiver.h:

* src/Communication/Receiver.h:

* src/Communication/AsioService.h:

* src/Communication/SynchReceiver.h:

A partial workaround for a hang when a single threaded app used streaming

assembler and did not specify wait for complete message.

* src/DotNetExamples/InterpretFASTDotNet/FieldSetInterpreter.cs:

* src/DotNetExamples/InterpretFASTDotNet/InterpretFASTDotNet.cs:

* src/Examples/InterpretApplication/InterpretApplication.h:

* src/Examples/InterpretApplication/InterpretApplication.cpp:

Add additional options to support echoing input, and generating

other debugging information.

This change addresses issues #61 and #65.

Tue Sep 14 15:06:01 UTC 2010 Dale Wilson <[email protected]>

* src/Tests/testFieldInstructions.cpp:

Add unit test for encoding optional decimal with zero exponent

Tue Sep 14 14:56:13 UTC 2010 Dale Wilson <[email protected]>

* src/Application/DecoderConnection.cpp:

Use the binary mode symbolic constant rather than #ifdef _WIN32

* src/Codecs/FieldInstructionDecimal.cpp:

Error in Decimal decoding for nullable filed with exponent of zero

Mon Aug 23 14:40:01 UTC 2010 Dale Wilson <[email protected]>

* src/Communication/LinkedBuffer.h:

Fix an error in managing mutex/condition that results in a hang due to buffer starvation.

Fri Aug 13 15:14:48 UTC 2010 Dale Wilson <[email protected]>

* setup.cmd:

Eliminate a duplicate line (?)

* setup_clear.cmd:

New batch file to allow setup to be re-run.

Fri Aug 13 15:06:34 UTC 2010 Dale Wilson <[email protected]>

* setup.cmd:

If BOOST_ROOT is set in environment, don't change it.

Do not include release directories in debug path.

Wed Aug 11 20:18:00 UTC 2010 Dale Wilson <[email protected]>

* setup.cmd:

Upgraded setup for VC10, aka Visual Studio 2010

Wed Aug 11 14:32:38 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/FieldInstructionInteger.h:

* src/Tests/testFieldInstructions.cpp:

* src/Tests/testFieldOperations.cpp:

"using namespace" should not appear in header file.

Remove it and repair the code that inadvertently depended on it.

Issue #58

* src/QuickFAST.mpc:

Difference between project name and target name confused MPC in VC10.

The MPC problem will be fixed, but for now, just use the same name for both.

Tue Aug 10 21:34:30 UTC 2010 Adam Mitz <[email protected]>

* QuickFASTApplication.mpb:

* QuickFASTExeOut.mpb:

* src/QuickFAST.mpc:

Visual Studio 2010 changes: replaced "specific(vc8,vc9)" with

"specific(prop:microsoft)".

Tue Aug 10 16:14:48 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/DataSourceBlockedStream.cpp:

* src/Codecs/DataSourceBufferedBlockedStream.cpp:

* src/Codecs/DataSourceBufferedStream.cpp:

* src/Codecs/DataSourceStream.cpp:

* src/Common/Types.h:

* src/Communication/RawFileReceiver.h:

Visual Studio 2010 has introduce new data types to represent position in file and

size of file. This adds casts of these types into size_t. Note if you are using

test data files larger than 4Gb you are out of luck.

Thu Jul 15 18:52:17 UTC 2010 Dale Wilson <[email protected]>

* src/Common/Logger.h:

Cosmetic: change parameter names.

* src/Communication/TCPReceiver.h:

Increment the iterator in the while loop to avoid waiting forever for a TCP connect.

Tue Jul 6 14:59:52 UTC 2010 Dale Wilson <[email protected]>

* src/Application/QuickFAST.h:

New file for use by QuickFAST-based applications.

Documentation will follow.

* src/Communication/MulticastSender.h:

* src/Examples/TutorialApplication/TutorialApplication.cpp:

Syntax errors in prevous check in.

Thu Jul 1 14:22:28 UTC 2010 Dale Wilson <[email protected]>

* src/Common/StringBuffer.h:

Allow a StringBuffer to be delegated to a std::string. This

simplifies some cases of MessageAccessor.

* src/Examples/TutorialApplication/TutorialApplication.cpp:

Change the handling of binary mode when opening templates & FAST files.

* src/Messages/FieldIdentity.h:

* src/Messages/FieldIdentity.cpp:

Change the order-of-initialization of memeber variables to match

the actual order in the object.

Move a constructor to the cpp file.

Wed Jun 30 15:12:25 UTC 2010 Dale Wilson <[email protected]>

* src/Communication/TCPReceiver.h:

Fix linux build error (gcc caught it, VC ignored it.)

* src/Codecs/Encoder_fwd.h:

Declare a shared pointer to an Encoder

* src/Codecs/FieldInstructionAscii.cpp:

Do not retrieve data for required, constant fields.

Fri Jun 25 18:31:09 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/Encoder.h:

* src/Codecs/Encoder.cpp:

* src/Messages/MessageAccessor.h:

* src/Messages/MessageAccessor.cpp:

Add new method, Encoder::encodeMessages() asks the accessor

for a template ID for the message and continues to encode

as long as the accessor returns an ID.

* src/Codecs/FieldInstructionBlob.cpp:

* src/Codecs/FieldInstructionDecimal.cpp:

* src/Codecs/FieldInstructionInteger.h:

* src/Tests/testFieldOperations.cpp:

When encoding mandatory constant values don't retrieve

them from the accessor. Just assume they are there and

have the correct value. Cuts down on application developer's

useless busywork.

Disable the test that expected an exception when a mandatory

constant field had the wrong value.

* src/Codecs/FieldOp.h:

* src/Codecs/SchemaElement.cpp:

Add the name of the operation to the "...not allowed in this

context" message

* src/Common/Decimal.cpp:

* src/Tests/testCommon.cpp:

Fix a problem comparing Decimals with differing exponents.

Unit test to catch it.

* src/Examples/Examples/CommandArgParser.cpp:

The -V and -? options were appearing multiple times when there

were multiple commmand argument handlers.

Thu Jun 24 19:47:45 UTC 2010 Dale Wilson <[email protected]>

* src/Common/Decimal.h:

* src/Common/Decimal.cpp:

* src/Tests/testCommon.cpp:

Fix some calculation problems revealed by new unit test in testCommon

-= was producing incorrect results

/= had normalization/rounding problems

* src/Communication/MulticastSender.h:

* src/Communication/MulticastSender_fwd.h:

New: support for sending via multicast

* src/Examples/FileToMulticast/FileToMulticast.h:

* src/Examples/FileToMulticast/FileToMulticast.cpp:

Switch to using MulticastSender

Tue Jun 22 14:18:32 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/DataDestination.h:

getBuffer returns a valid handle even before the DataDestination

is used.

* src/Communication/TCPReceiver.h:

Fix an initialization problem.

Add methods to send data back to the counterparty via the TCP socket.

In particular you can pass a DataDestination containing

encoded data to the send() method and it will be sent to the socket.

* src/Examples/FileToTCP/FileToTCP.h:

* src/Examples/FileToTCP/FileToTCP.cpp:

Temporary: add a '-hack" option that simply listens and echo's

any response from the sender. This really should be a separate

program.

* src/Examples/InterpretApplication/InterpretApplication.cpp:

Temporary: add a console command 'h' that sends "Hello, World!"

back thru the TCPReceiver. Throws and exception if not configured

for TCP.

Fri Jun 18 14:22:29 UTC 2010 Dale Wilson <[email protected]>

* src/Application/DecoderConnection.cpp:

* src/Codecs/XMLTemplateParser.h:

Move #include to reduce compile-time coupling.

* src/Examples/Examples.mpc:

* src/Examples/InterpretFAST:

* src/Examples/InterpretFAST/InterpretFAST.h:

* src/Examples/InterpretFAST/InterpretFAST.cpp:

* src/Examples/InterpretFAST/main.cpp:

* src/Examples/MulticastInterpreter:

* src/Examples/MulticastInterpreter/MulticastInterpreter.h:

* src/Examples/MulticastInterpreter/MulticastInterpreter.cpp:

* src/Examples/MulticastInterpreter/main.cpp:

Removed InterpretFAST and MulticastInterpreter. The

InterpretApplication provides all capabilities from these

programs (and much more).

Some command line options need to be changed to use

InterpretApplication rather than InterpretFAST and MulicastInterpreter:

Replace with

-f filename -file filename

-o output_file >>output_file

-head count -limit count

-r -reset

-s -strict

-vp, -vd, -vx -vo filename

-b size -buffersize size

-# count -buffers count

-l ip -mlisten ip

-m ip -p port -multicast ip:port

Thu Jun 17 15:09:43 UTC 2010 Dale Wilson <[email protected]>

* src/Communication/MulticastReceiver.h:

* src/Communication/TCPReceiver.h:

Provide direct access to the sockets inside the *Receivers

for special purpose needs. Until the encoder work is complete

this can be used to send to the TCP counterpary. The multicast

method is there only for completeness.

Fri Jun 11 17:37:28 UTC 2010 Dale Wilson <[email protected]>

* src/Messages/MessageFormatter.h:

Include file name capitalization error.

Fri Jun 11 15:45:55 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/FieldInstruction.h:

* src/Codecs/FieldInstruction.cpp:

* src/Codecs/FieldInstructionTemplateRef.h:

* src/Codecs/FieldInstructionTemplateRef.cpp:

* src/Codecs/SegmentBody.cpp:

Improve handling of recursive templateRefs.

This addresses Issue #57. The new testSequences

was the test that revealed this problem (thanks Matt).

There are still possible pathological cases but they

are much less likely to be used.

* src/Codecs/XMLTemplateParser.cpp:

* src/Codecs/TemplateRegistry.cpp:

Improve formatting of verbose output to make the results more

like legal XML.

* src/Messages/MessageFormatter.cpp:

Changes to make displays of complex messages more readable.

* src/Codecs/FieldInstructionGroup.cpp:

Change handling of groups to make merging group fields

into the parent segment more under the control of the

application. This addresses a problem that showed

up trying to write a round-trip test. If the group was

merged by the decoder, then the generic accessor used

by the encoder couldn't find it because it no longer

existed as a group. Hence the round-trip would not

accurately reproduce the original input.

* src/Tests/testFieldInstructions.cpp:

* src/Tests/testGroupReferences1.cpp:

* src/Tests/testSequences.cpp:

New or Improved tests for the above.

Wed Jun 2 15:49:44 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/DataDestination.h:

* src/Codecs/Encoder.cpp:

* src/Codecs/FieldInstructionAscii.cpp:

* src/Codecs/FieldInstructionGroup.cpp:

* src/Codecs/PresenceMap.cpp:

* src/Common/QuickFAST_Export.h:

* src/Common/WorkingBuffer.h:

* src/Common/WorkingBuffer.cpp:

* src/Examples/Examples/MessageInterpreter.h:

* src/Examples/Examples/MessageInterpreter.cpp:

Add quite a bit of additional debugging information to verbose displays.

All of which was necessary in order to diagnose the problem

reported in Issue 56.

Issue 56 turned out to be a buffer management problem during

encoding nested groups. The encoder ended up encoding into the

wrong partial buffer after returning from nested groups.

* src/Messages/MessageFormatter.h:

* src/Messages/MessageFormatter.cpp:

Extract message formatting into separate class

to make generating debug/diagnostics messages easier.

* src/Tests/testGroupReferences1.cpp:

The test included as part of Issue #56 turned into a new unit test.

Note that it differs quite a bit from the original submission.

Thu May 27 15:31:03 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/MessagePerPacketAssembler.cpp:

Resset the DataSource after decoding errors so the decoder

will skip to the beginning of the next packet.

Issue # 55

Wed May 26 15:13:49 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/DataDestination.h:

* src/Codecs/DataSource.h:

* src/Codecs/FieldOp.h:

* src/Codecs/FixedSizeHeaderAnalyzer.h:

* src/Codecs/NoHeaderAnalyzer.h:

* src/Examples/Examples/ValueToFix.h:

* src/Messages/FieldIdentity.h:

* src/Messages/FieldSet.h:

* src/Messages/FieldSet.cpp:

* src/Messages/MessageAccessor.h:

* src/Messages/SpecialAccessors.h:

* src/Tests/testBiggestValue.cpp:

Update Doxygen comments to track recent changes.

Remove the getField by name method from field set. Getting

a field from a field set now always requires a FieldIdentity.

Change the constructor for a FieldIdentity to includde ID.

Change the equality operator for FieldIdentity so the ID

is only compared if it is specified in both of the identities

being compared. -- Matching names are good enough if the

id is not available.

Tue May 25 18:51:22 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/XMLTemplateParser.cpp:

Use XMLString::release to release Xerces-allocated strings.

* src/Examples/Examples/ValueToFix.h:

* src/Examples/Examples/ValueToFix.cpp:

New ValueMessageBuilder that writes a FIX data file.

* src/Examples/InterpretApplication/InterpretApplication.h:

* src/Examples/InterpretApplication/InterpretApplication.cpp:

-ofix option uses ValueToFix (i.e. interprets the messages as FIX messages)

-console enables console commands: <q>uit <p>ause and <r>esume

* src/Messages/ValueMessageBuilder.h:

* src/Messages/ValueMessageBuilder_fwd.h:

Fix minor whitespace formatting issue.

Declare smart pointer to ValueMessageBuilder for occasional use.

Fri May 21 20:44:05 UTC 2010 Dale Wilson <[email protected]>

* src/Messages/MessageAccessor.cpp:

New file, missing from previous checkin.

Fri May 21 18:37:24 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/DataDestination.h:

Add support for asio gather writes

* src/Codecs/DataSource.h:

* src/Codecs/DataSource.cpp:

Remove deprecated methods

* src/Codecs/FieldInstruction.h:

* src/Codecs/FieldInstruction.cpp:

* src/Codecs/FieldInstructionAscii.cpp:

* src/Codecs/FieldInstructionBlob.h:

* src/Codecs/FieldInstructionBlob.cpp:

* src/Codecs/FieldInstructionDecimal.cpp:

* src/Codecs/FieldInstructionGroup.cpp:

* src/Codecs/FieldInstructionInteger.h:

* src/Codecs/FieldInstructionSequence.cpp:

* src/Codecs/FieldInstructionTemplateRef.cpp:

* src/Codecs/FieldInstructionUInt32.h:

* src/Messages/FieldIdentity.h:

* src/Messages/FieldSet.h:

* src/Messages/FieldSet.cpp:

* src/Messages/MessageAccessor.h:

* src/Messages/SpecialAccessors.h:

Switch to retrieving application data by specific value

rather than by generic field.

* src/Codecs/FixedSizeHeaderAnalyzer.h:

* src/Codecs/FixedSizeHeaderAnalyzer.cpp:

* src/Codecs/HeaderAnalyzer.h:

Add the ability to reset the analyzer in case

something happens while processing the header.

* src/Codecs/MessagePerPacketAssembler.h:

* src/Codecs/MessagePerPacketAssembler.cpp:

Rename buffer_ and size_ to avoid name conflicts

with DataSource base class.

Add additional debug info when verbose is turned on.

Reset the HeaderAnalyzer when appropriate.

* src/Communication/AsynchReceiver.h:

* src/Communication/MulticastReceiver.h:

* src/Communication/Receiver.h:

Remove perfect filter. It didn't solve the problem.

Add support for pausing and resuming a multicast receiver.

* src/Communication/PCapReader.h:

* src/Communication/PCapReader.cpp:

Add support for "Linux cooked" headers in pcap file.

* src/Examples/InterpretApplication/InterpretApplication.h:

* src/Examples/InterpretApplication/InterpretApplication.cpp:

Add console "commands" (p)ause; (r)esume; (q)uit.

Enable with the -console option.

to use: type the letter, hit Enter

Tue May 18 13:20:47 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/MessagePerPacketAssembler.cpp:

Clear remaining data when headerAnalyzer sets skip to true.

* src/Messages/Field.h:

* src/Messages/Field.cpp:

* src/Messages/FieldAscii.h:

* src/Messages/FieldAscii.cpp:

* src/Messages/FieldByteVector.h:

* src/Messages/FieldByteVector.cpp:

* src/Messages/FieldInt16.h:

* src/Messages/FieldInt16.cpp:

* src/Messages/FieldInt32.h:

* src/Messages/FieldInt32.cpp:

* src/Messages/FieldInt64.h:

* src/Messages/FieldInt64.cpp:

* src/Messages/FieldInt8.h:

* src/Messages/FieldInt8.cpp:

* src/Messages/FieldString.h:

* src/Messages/FieldString.cpp:

* src/Messages/FieldUInt16.h:

* src/Messages/FieldUInt16.cpp:

* src/Messages/FieldUInt32.h:

* src/Messages/FieldUInt32.cpp:

* src/Messages/FieldUInt64.h:

* src/Messages/FieldUInt64.cpp:

* src/Messages/FieldUInt8.h:

* src/Messages/FieldUInt8.cpp:

* src/Messages/FieldUtf8.h:

* src/Messages/FieldUtf8.cpp:

Preparing for value-based encoding.

Fri May 14 16:09:19 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/DataDestination.h:

* src/Common/WorkingBuffer.h:

* src/Common/WorkingBuffer.cpp:

* src/Tests/testCommon.cpp:

Remove DataDestination IOVec support -- I'll try again later

Add DataDestination::toWorkingBuffer() -- preferred way to

get contiguous data

Add WorkingBuffer::append() and WorkingBuffer::toString()

Unit tests for WorkingBuffer (needs more!)

* src/Tests/testGroupReferences.cpp:

Fix formatting

Switch to BOOST_REQUIRE to avoid a seg fault after failure

Mon May 10 20:28:47 UTC 2010 Dale Wilson <[email protected]>

* m.cmd:

Hide REM statements when running m.cmd

Mon May 10 15:59:03 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/DataDestination.h:

* src/Codecs/Encoder.cpp:

Linux build error in verbose code.

While I'm in there, change verbose to use an ostream

rather than just a bool to all redirected output.

Mon May 10 15:20:38 UTC 2010 Dale Wilson <[email protected]>

* QuickFAST.features:

Turn the .NET build back off by default because the doc

says it defaults to off.

* m.cmd:

Add option to expand environment variables into the solution

and project files because not everyone runs Visual Studio from

the command line.

Fri May 7 15:30:45 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/DataDestination.h:

* src/Codecs/DataDestinationString.h:

* src/Common/WorkingBuffer.h:

* src/Communication/AsynchReceiver.h:

* src/Communication/MulticastReceiver.h:

* src/Communication/Receiver.h:

* src/Tests/testBiggestValue.cpp:

* src/Tests/testFieldInstructions.cpp:

* src/Tests/testFieldOperations.cpp:

* src/Tests/testGroupReferences.cpp:

* src/Tests/testPresenceMap.cpp:

* src/Tests/testRoundTrip.cpp:

* src/Tests/testRoundTrip1.cpp:

* src/Tests/testRoundTripFieldOps.cpp:

* src/Tests/testSmallestValue.cpp:

The previous change to DataDestination rendered

DataDestinationString redundant. Since

DataDestinationBuffer is new, I simply promoted

its functionality into DataDestination. For backward

compatibility DataDestinationString::toValue has been

replaced by a thunk that forwards the toString method

to DataDestination.

To support some semblence of efficiency the signature

of toString has been changed to accept reference to

a string in which to return the results.

* src/Codecs/DataDestinationBuffer.h:

* src/Codecs/DataDestinationBuffer.cpp:

* src/Codecs/DataDestinationString.cpp:

* src/Tests/DataDestinationMock.h:

Removed these files.

Thu May 6 20:51:30 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/DataDestination.h:

* src/Codecs/DataDestinationBuffer.cpp:

* src/Codecs/DataDestinationString.h:

* src/Codecs/DataDestinationString.cpp:

* src/Codecs/DatadestinationBuffer.h:

* src/Codecs/Encoder.cpp:

* src/Codecs/FieldInstructionAscii.cpp:

* src/Codecs/FieldInstructionBlob.cpp:

* src/Common/WorkingBuffer.h:

* src/Common/WorkingBuffer.cpp:

* src/Tests/DataDestinationMock.h:

* src/Tests/testBiggestValue.cpp:

* src/Tests/testFieldInstructions.cpp:

* src/Tests/testFieldOperations.cpp:

* src/Tests/testGroupReferences.cpp:

* src/Tests/testPresenceMap.cpp:

* src/Tests/testRoundTrip.cpp:

* src/Tests/testRoundTrip1.cpp:

* src/Tests/testRoundTripFieldOps.cpp:

* src/Tests/testSmallestValue.cpp:

Change DataDestination to allow it to be reused.

The clear() method will empty the destination but

will not release buffers. When the destination is

reused, it won't need to allocate new buffers. Also

the buffers will grow to the "right" size and stay

there. (The general approach was suggested by

carlosz--blame me for the specific implementation,

though.)

Add new DataDestination type: DataDestinationBuffer.

DataDestinationString was a quick/dirty implementation

designed to support getting the encoder working.

DataDestinationBuffer collects data into buffers

suitable for use with scatter/gather I/O. It also

has a toString method so it duplicates the capabilities

of DataDestinationString.

IMPORTANT: The toString() method is NOT efficient.

It is intended for debugging/testing, not for production

use.

I switched all the tests over to using DataDestinationBuffer

so DataDestinationString can be retired eventually.

And while testing this, I found a problem in tail encoding

of missing fields for Ascii, UTF8, and ByteVector fields

That got fixed in this checkin, too.

Wed May 5 21:01:37 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/FieldInstruction.h:

* src/Codecs/FieldInstruction.cpp:

Enable unrolled encodeUnsignedInteger

Relax overflow check slightly for unsigned numbers. Bits that must be sent

to reach a byte boundary but which do not take part in the result will be

ignored. Previously these bits had to match the high order bit.

For signed decoding these bits must still match the sign bit.

* src/Codecs/FieldInstructionInteger.h:

Spelling error in error message

Mon May 3 15:27:40 UTC 2010 Dale Wilson <[email protected]>

* setup.cmd:

Check %BOOST_ROOT%/boost in addition to %BOOST_ROOT%/lib

* src/Codecs/Context.h:

Pass value by reference to setDictionaryValue

* src/Codecs/FieldInstruction.h:

* src/Codecs/FieldInstruction.cpp:

Provide alternative getSegmentbodyPtr that throws rather than returning status.

Unroll the integer encoders (need to test performance to see if this is worth it.)

* src/Codecs/FieldInstructionAscii.h:

* src/Codecs/FieldInstructionAscii.cpp:

Remove an unnecessary field create.

Make FieldInstructionAscii::fieldInstructionType() public.

Thanks to Carlosz for suggesting most of these changes.

Tue Apr 27 21:21:44 UTC 2010 Dale Wilson <[email protected]>

* src/Application/DecoderConfiguration.h:

* src/Application/DecoderConnection.cpp:

* src/Codecs/FixedSizeHeaderAnalyzer.h:

* src/Codecs/FixedSizeHeaderAnalyzer.cpp:

* src/Codecs/NoHeaderAnalyzer.h:

* src/Examples/InterpretApplication/InterpretApplication.cpp:

Add a hook for testing the "skip this packet" feature.

TestSkip forces the header analyzer to

skip every 'n'th packet.

* src/Codecs/Encoder.cpp:

Fix a spelling mistake

* src/Common/Decimal.cpp:

Add leading zero before decimal point in toString.

Avoid making a temporary to return the string value.

* src/Messages/FieldSet.cpp:

* src/Tests/testGroupReferences.cpp:

* src/Tests/testRoundTripFieldOps.cpp:

Issue #52 heap allocation error after decoding.

If field set needed to grow to support additional fields

it grew by 50% (i.e. size = size * 3 / 2.)

This worked fine unless size started at 1 (oops).

Thu Apr 22 15:11:47 UTC 2010 Dale Wilson <[email protected]>

* src/Common/Logger.h:

Add virtual destructor to Logger. See Issue # 48.

Thu Apr 22 14:54:02 UTC 2010 Dale Wilson <[email protected]>

* src/Communication/LinkedBuffer.h:

Add a missing return statement. See Issue#47.

Wed Apr 14 19:43:47 UTC 2010 Dale Wilson <[email protected]>

* src/Application/DecoderConfiguration.h:

The nonstandard_ member variable was not initialized

* src/Application/DecoderConnection.cpp:

Decoder Connection was not opening the XML file in binary mode on Windows

* src/Common/Decimal.cpp:

Decimal formatting using boost lexical cast was producing sloppy results

i.e. 3.99999999999999 rather than 4.0

I hand coded a formatter that produces a string that exactly represents the decimal value.

* src/Examples/InterpretApplication/InterpretApplication.cpp:

Cosmetic: Fix a line that was indented incorrectly.

Wed Apr 14 18:15:30 UTC 2010 Dale Wilson <[email protected]>

* src/Application/DecoderConnection.cpp:

* src/Codecs/FieldInstruction.h:

* src/Codecs/FieldInstruction.cpp:

* src/Codecs/FieldInstructionAscii.h:

* src/Codecs/FieldInstructionAscii.cpp:

* src/Codecs/FieldInstructionBlob.h:

* src/Codecs/FieldInstructionBlob.cpp:

* src/Codecs/FieldInstructionDecimal.h:

* src/Codecs/FieldInstructionDecimal.cpp:

* src/Codecs/FieldInstructionExponent.h:

* src/Codecs/FieldInstructionGroup.h:

* src/Codecs/FieldInstructionGroup.cpp:

* src/Codecs/FieldInstructionInteger.h:

* src/Codecs/FieldInstructionMantissa.h:

* src/Codecs/FieldInstructionSequence.h:

* src/Codecs/FieldInstructionSequence.cpp:

* src/Codecs/FieldInstructionTemplateRef.h:

* src/Codecs/FieldInstructionTemplateRef.cpp:

* src/Codecs/FieldInstructionUInt32.h:

* src/Codecs/FieldOp.h:

* src/Codecs/FieldOp.cpp:

* src/Codecs/FieldOpConstant.h:

* src/Codecs/FieldOpConstant.cpp:

* src/Codecs/FieldOpCopy.h:

* src/Codecs/FieldOpCopy.cpp:

* src/Codecs/FieldOpDefault.h:

* src/Codecs/FieldOpDefault.cpp:

* src/Codecs/FieldOpDelta.h:

* src/Codecs/FieldOpDelta.cpp:

* src/Codecs/FieldOpIncrement.h:

* src/Codecs/FieldOpIncrement.cpp:

* src/Codecs/FieldOpNop.h:

* src/Codecs/FieldOpTail.h:

* src/Codecs/FieldOpTail.cpp:

* src/Codecs/SegmentBody.h:

* src/Codecs/SegmentBody.cpp:

* src/Codecs/XMLTemplateParser.cpp:

* src/Common/Types.h:

* src/Common/Types.cpp:

* src/DotNet/ImplField.cpp:

* src/Examples/Examples/MessageInterpreter.cpp:

* src/Messages/FieldIdentity.cpp:

* src/Tests/FieldInstructionMock.h:

* src/Tests/testFieldInstructions.cpp:

* src/Tests/testXMLTemplateParser.cpp:

Issue#42 pointed out a problem with the way the presence map interacted

with groups. There are three parts to this checkin:

1) Add a display(ostream, indent) method to the various components of

an in-memory template/template registry. This allows the contents

of the registry to be dumped after the XML file is compiled. The

dump includes information about PMAP usage that was used to

diagnose this problem.

2) Add a new unit test in testXMLTemplateParser: testGroupsAndSequencesVsPMAP.

This test detected the problem and verfied that it was fixed.

Also correct an incorrect test in testFieldInstructions which

was triggered by the fix.

3) Fix the problem (the change is in in FieldInstructionGroup)

* Output/TestData:

This was used by the old .NET tests which are gone. We need new tests,

but when they happen they won't read templates from a file.

Tue Apr 13 21:02:51 UTC 2010 Dale Wilson <[email protected]>

* src/Codecs/FieldInstruction.h:

* src/Codecs/FieldInstruction.cpp: