protobuf/conformance
Derek Perez bc45f92262
Bazel powered Java testing (#8506)
* Protobuf Java/Core Tests running w/ Bazel.

Also integrates rules_jvm_external and migrates existing maven deps
in place.

* Add test_suite target that maps to rule name.

* Lite tests passing in Bazel

* util tests passing with Bazel.

* Add conformance and build testing to //java:core

* Cleanup bzl style and lock down access to failure lists.

* Adding Java Lite conformance tests.

* rm newline

* parameterize conformance_test

This makes usage of failure lists more explicit.

* restrict visibility more for newly added libs and fix formatting.

* fix formatting and visibility.

* move testing.bzl to an internal package.

* fix file formatting.

* moving conformance_test to internal.bzl
2021-04-20 11:36:32 -07:00
..
third_party/jsoncpp Sync from Piper @327110949 2020-08-17 15:26:13 -07:00
autoload.php
binary_json_conformance_suite.cc Sync from Piper @368866736 2021-04-16 09:55:03 -07:00
binary_json_conformance_suite.h Sync from Piper @310457838 2020-05-07 16:21:50 -07:00
conformance_cpp.cc Fix conformance_cpp 2021-03-10 10:05:31 +01:00
conformance_nodejs.js fix conformance test for text format 2019-02-26 13:46:30 -08:00
conformance_objc.m Down integrate to GitHub 2019-08-22 17:33:01 -07:00
conformance_php.php Set execute bit on files if and only if they begin with (#!). (#7347) 2020-04-01 15:28:25 -07:00
conformance_python.py Sync from Piper @305053102 2020-04-06 09:57:03 -07:00
conformance_ruby.rb Ported Ruby extension to upb_msg (#8184) 2021-01-13 12:16:25 -08:00
conformance_test_main.cc down integration from internal 2019-02-22 18:13:33 +08:00
conformance_test_runner.cc Fix compiler warnings issue found in conformance_test_runner#8189 (#8190) 2021-02-11 16:29:47 -08:00
conformance_test_runner.sh Bazel powered Java testing (#8506) 2021-04-20 11:36:32 -07:00
conformance_test.cc Down Integrate Internal Changes 2019-11-12 13:38:58 -08:00
conformance_test.h Sync from Piper @308829107 2020-04-28 08:40:38 -07:00
conformance.proto Fix lots of spelling errors (#7751) 2020-08-10 11:08:25 -07:00
ConformanceJava.java Sync from Piper @368734211 2021-04-15 15:53:17 -07:00
ConformanceJavaLite.java Sync from Piper @368734211 2021-04-15 15:53:17 -07:00
failure_list_cpp.txt Sync from Piper @310858019 2020-05-11 00:12:20 -07:00
failure_list_csharp.txt Sync from Piper @368903491 2021-04-16 12:59:54 -07:00
failure_list_java_lite.txt Sync from Piper @368903491 2021-04-16 12:59:54 -07:00
failure_list_java.txt Sync from Piper @311396324 2020-05-13 13:46:15 -07:00
failure_list_jruby.txt Set up testing configuration for jruby 2020-12-11 16:02:41 -08:00
failure_list_js.txt Sync from Piper @334206209 2020-09-28 11:54:54 -07:00
failure_list_objc.txt Fix enum writing. 2019-08-26 17:17:32 -04:00
failure_list_php_c.txt Sync from Piper @368903491 2021-04-16 12:59:54 -07:00
failure_list_php.txt Sync from Piper @368903491 2021-04-16 12:59:54 -07:00
failure_list_python_cpp.txt Sync from Piper @316511779 2020-06-15 11:48:47 -07:00
failure_list_python-post26.txt
failure_list_python.txt Sync from Piper @316511779 2020-06-15 11:48:47 -07:00
failure_list_ruby.txt Sync from Piper @368903491 2021-04-16 12:59:54 -07:00
Makefile.am Ported Ruby extension to upb_msg (#8184) 2021-01-13 12:16:25 -08:00
README.md Replace repo links. 2018-08-22 11:55:30 -07:00
text_format_conformance_suite.cc Sync from Piper @364389596 2021-03-22 13:05:55 -07:00
text_format_conformance_suite.h Sync from Piper @308829107 2020-04-28 08:40:38 -07:00
text_format_failure_list_cpp.txt Sync from Piper @334206209 2020-09-28 11:54:54 -07:00
text_format_failure_list_csharp.txt Update conformance test failures 2019-03-20 14:43:42 -07:00
text_format_failure_list_java_lite.txt Sync from Piper @368903491 2021-04-16 12:59:54 -07:00
text_format_failure_list_java.txt Sync from Piper @338284531 2020-10-21 10:04:14 -07:00
text_format_failure_list_jruby.txt Set up testing configuration for jruby 2020-12-11 16:02:41 -08:00
text_format_failure_list_php.txt Update conformance test failures 2019-03-20 14:43:42 -07:00
text_format_failure_list_python_2.7.txt Added text format failure list for Python 2.7. 2020-10-28 10:05:07 -07:00
text_format_failure_list_python_cpp_2.7.txt Added Python 2.7-specific failure list for Python/C++ also. 2020-10-28 10:35:06 -07:00
text_format_failure_list_python_cpp.txt Sync from Piper @334206209 2020-09-28 11:54:54 -07:00
text_format_failure_list_python.txt Sync from Piper @334206209 2020-09-28 11:54:54 -07:00
text_format_failure_list_ruby.txt Update conformance test failures 2019-03-20 14:43:42 -07:00
update_failure_list.py

Protocol Buffers - Google's data interchange format

Copyright 2008 Google Inc.

This directory contains conformance tests for testing completeness and correctness of Protocol Buffers implementations. These tests are designed to be easy to run against any Protocol Buffers implementation.

This directory contains the tester process conformance-test, which contains all of the tests themselves. Then separate programs written in whatever language you want to test communicate with the tester program over a pipe.

Before running any of these tests, make sure you run make in the base directory to build protoc, since all the tests depend on it.

$ make

Running the tests for C++

To run the tests against the C++ implementation, run:

$ cd conformance && make test_cpp

Running the tests for JavaScript (Node.js)

To run the JavaScript tests against Node.js, make sure you have "node" on your path and then run:

$ cd conformance && make test_nodejs

Running the tests for Ruby (MRI)

To run the Ruby tests against MRI, first build the C extension:

$ cd ruby && rake

Then run the tests like so:

$ cd conformance && make test_ruby

Running the tests for other languages

Most of the languages in the Protobuf source tree are set up to run conformance tests. However some of them are more tricky to set up properly. See tests.sh in the base of the repository to see how Travis runs the tests.

Testing other Protocol Buffer implementations

To run these tests against a new Protocol Buffers implementation, write a program in your language that uses the protobuf implementation you want to test. This program should implement the testing protocol defined in conformance.proto. This is designed to be as easy as possible: the C++ version is only 150 lines and is a good example for what this program should look like (see conformance_cpp.cc). The program only needs to be able to read from stdin and write to stdout.

Portability

Note that the test runner currently does not work on Windows. Patches to fix this are welcome! (But please get in touch first to settle on a general implementation strategy).