History

Thomas Van Lenten 80f65d2df8 Add note about JSON tests maybe being wrong. (#1992 ) Add note about JSON tests maybe being wrong. - Add note about the JSON test maybe not being correct yet. - Add test to checks the generated names for double underscores to be sure they are what is expected.		2016-08-23 08:19:45 -04:00
..
third_party/jsoncpp	Make conformance tests build for C++ and Java.	2015-12-16 13:38:10 -08:00
conformance_cpp.cc	Down-integrate from internal code base.	2015-12-11 17:10:28 -08:00
conformance_objc.m	Fix up the conformance tests	2016-01-05 16:31:40 -05:00
conformance_python.py	Remove all bare strings as exceptions.	2015-12-04 15:03:12 -08:00
conformance_ruby.rb	Ruby: generated foo.proto -> foo_pb.rb instead of foo.rb.	2016-07-25 11:09:23 -07:00
conformance_test_runner.cc	Make conformance tests more strict about the failure list.	2016-06-03 09:39:38 -07:00
conformance_test.cc	Add note about JSON tests maybe being wrong. (#1992 )	2016-08-23 08:19:45 -04:00
conformance_test.h	Add conformance test for zero fields in oneofs. (#1939 )	2016-08-11 09:44:07 -04:00
conformance.proto	Add more JSON tests around underscores (#1963 )	2016-08-16 09:02:27 -04:00
ConformanceJava.java	Integrate google internal changes.	2016-03-30 11:39:59 -07:00
ConformanceJavaLite.java	Fix spelling in strings and comments	2016-07-03 15:26:04 +03:00
failure_list_cpp.txt	Add note about JSON tests maybe being wrong. (#1992 )	2016-08-23 08:19:45 -04:00
failure_list_csharp.txt	Add note about JSON tests maybe being wrong. (#1992 )	2016-08-23 08:19:45 -04:00
failure_list_java.txt	Add note about JSON tests maybe being wrong. (#1992 )	2016-08-23 08:19:45 -04:00
failure_list_objc.txt	Record zero for "has" for proto3 if in a oneof.	2016-08-11 13:14:15 -04:00
failure_list_python_cpp.txt	Add note about JSON tests maybe being wrong. (#1992 )	2016-08-23 08:19:45 -04:00
failure_list_python-post26.txt	Updated C#'s failure list, and added missing file.	2016-01-11 16:15:46 -08:00
failure_list_python.txt	Add note about JSON tests maybe being wrong. (#1992 )	2016-08-23 08:19:45 -04:00
failure_list_ruby.txt	Add note about JSON tests maybe being wrong. (#1992 )	2016-08-23 08:19:45 -04:00
Makefile.am	Fix up ignores and conformance generation	2016-08-15 16:33:22 -04:00
README.md	Added first version of conformance tests.	2015-04-08 13:14:10 -07:00
update_failure_list.py	Added update_failure_list.py.	2016-06-03 09:39:38 -07:00

README.md

Protocol Buffers - Google's data interchange format

This directory contains conformance tests for testing completeness and correctness of Protocol Buffers implementations. These tests are designed to be easy to run against any Protocol Buffers implementation.

This directory contains the tester process conformance-test, which contains all of the tests themselves. Then separate programs written in whatever language you want to test communicate with the tester program over a pipe.

Before running any of these tests, make sure you run make in the base directory to build protoc, since all the tests depend on it.

$ make

Then to run the tests against the C++ implementation, run:

$ cd conformance && make test_cpp

More tests and languages will be added soon!

Testing other Protocol Buffer implementations

To run these tests against a new Protocol Buffers implementation, write a program in your language that uses the protobuf implementation you want to test. This program should implement the testing protocol defined in conformance.proto. This is designed to be as easy as possible: the C++ version is only 150 lines and is a good example for what this program should look like (see conformance_cpp.cc). The program only needs to be able to read from stdin and write to stdout.

Portability

Note that the test runner currently does not work on Windows. Patches to fix this are welcome! (But please get in touch first to settle on a general implementation strategy).