protobuf/conformance
Joshua Haberman f1ce60e7b4 Factored Conformance and Benchmark test messages into shared test schema. (#1971)
* Factored Conformance test messages into shared test schema.

* Updated benchmarks to use new proto3 message locations.

* Fixed include path.

* Conformance: fixed include of Python test messages.

* Make maven in Rakefile use --batch-mode.

* Revert changes to benchmarks.

On second thought I think a separate schema for
CPU benchmarking makes sense.

* Try regenerating C# protos for new test protos.

* Removed benchmark messages from test proto.

* Added Jon Skeet's fixes for C#.

* Removed duplicate/old test messages C# file.

* C# fixes for test schema move.

* Fixed C# to use the correct TestAllTypes message.

* Fixes for Objective C test schema move.

* Added missing EXTRA_DIST file.
2016-12-03 11:51:25 -05:00
..
third_party/jsoncpp Make conformance tests build for C++ and Java. 2015-12-16 13:38:10 -08:00
conformance_cpp.cc Factored Conformance and Benchmark test messages into shared test schema. (#1971) 2016-12-03 11:51:25 -05:00
conformance_objc.m Factored Conformance and Benchmark test messages into shared test schema. (#1971) 2016-12-03 11:51:25 -05:00
conformance_python.py Factored Conformance and Benchmark test messages into shared test schema. (#1971) 2016-12-03 11:51:25 -05:00
conformance_ruby.rb Factored Conformance and Benchmark test messages into shared test schema. (#1971) 2016-12-03 11:51:25 -05:00
conformance_test_runner.cc Integrate internal changes 2016-10-10 11:23:36 -07:00
conformance_test.cc Factored Conformance and Benchmark test messages into shared test schema. (#1971) 2016-12-03 11:51:25 -05:00
conformance_test.h Factored Conformance and Benchmark test messages into shared test schema. (#1971) 2016-12-03 11:51:25 -05:00
conformance.proto Factored Conformance and Benchmark test messages into shared test schema. (#1971) 2016-12-03 11:51:25 -05:00
ConformanceJava.java Factored Conformance and Benchmark test messages into shared test schema. (#1971) 2016-12-03 11:51:25 -05:00
ConformanceJavaLite.java Fix spelling in strings and comments 2016-07-03 15:26:04 +03:00
failure_list_cpp.txt Integrated internal changes from Google 2016-11-17 16:59:59 -08:00
failure_list_csharp.txt Update conformance failure lists. 2016-11-18 15:36:18 -08:00
failure_list_java.txt Updated failure_list_java.txt for Java conformance test 2016-11-22 10:31:12 -08:00
failure_list_objc.txt Record zero for "has" for proto3 if in a oneof. 2016-08-11 13:14:15 -04:00
failure_list_python_cpp.txt Integrated internal changes from Google 2016-11-17 16:59:59 -08:00
failure_list_python-post26.txt Updated C#'s failure list, and added missing file. 2016-01-11 16:15:46 -08:00
failure_list_python.txt Integrated internal changes from Google 2016-11-17 16:59:59 -08:00
failure_list_ruby.txt Update conformance failure lists. 2016-11-18 15:36:18 -08:00
Makefile.am Factored Conformance and Benchmark test messages into shared test schema. (#1971) 2016-12-03 11:51:25 -05:00
README.md Added first version of conformance tests. 2015-04-08 13:14:10 -07:00
update_failure_list.py Added update_failure_list.py. 2016-06-03 09:39:38 -07:00

Protocol Buffers - Google's data interchange format

Build Status

Copyright 2008 Google Inc.

This directory contains conformance tests for testing completeness and correctness of Protocol Buffers implementations. These tests are designed to be easy to run against any Protocol Buffers implementation.

This directory contains the tester process conformance-test, which contains all of the tests themselves. Then separate programs written in whatever language you want to test communicate with the tester program over a pipe.

Before running any of these tests, make sure you run make in the base directory to build protoc, since all the tests depend on it.

$ make

Then to run the tests against the C++ implementation, run:

$ cd conformance && make test_cpp

More tests and languages will be added soon!

Testing other Protocol Buffer implementations

To run these tests against a new Protocol Buffers implementation, write a program in your language that uses the protobuf implementation you want to test. This program should implement the testing protocol defined in conformance.proto. This is designed to be as easy as possible: the C++ version is only 150 lines and is a good example for what this program should look like (see conformance_cpp.cc). The program only needs to be able to read from stdin and write to stdout.

Portability

Note that the test runner currently does not work on Windows. Patches to fix this are welcome! (But please get in touch first to settle on a general implementation strategy).