protobuf/php
Joshua Haberman 75de6aa21a Fixed sub-message getters for well-known types when message is unset.
The well-known types generate C code into wkt.inc, and this C code was
not testing isset($msg->submsg_field) like the generated code does:

```php
// PHP generated getter: checks isset().
public function getOptions()
{
    return isset($this->options) ? $this->options : null;
}
```

```c
// C generated getter, does not check upb_msg_has()
static PHP_METHOD(google_protobuf_Value, getListValue) {
  Message* intern = (Message*)Z_OBJ_P(getThis());
  const upb_fielddef *f = upb_msgdef_ntofz(intern->desc->msgdef,
                                           "list_value");
  zval ret;
  Message_get(intern, f, &ret);
  RETURN_COPY_VALUE(&ret);
}
```

This led to an error where we wnuld try to get a sub-message field from upb
when it `upb_msg_has(msg, field) == false`, which is an error according to upb.

There are two possible fixes for this bug. A guiding principle is that we want
the generated C code in wkt.inc to have the same behavior as PHP generated
code. Following this principle, the two possible fixes are:

1. Change the code generator for wkt.inc to check upb_msg_has(f) before
   calling Message_get(). This would match the isset() check that the
   The PHP generated code does, and we would leave the PHP code unchanged.

2. Change Message_get() to itself perform the upb_msg_has(f) check for
   sub-message fields. This means that generated code would no longer need
   to perform an isset() check, so we would want to remove this check from
   the PHP generated code also to avoid a redundant check.

Both of these are reasonable fixes, and it is not immediately obvious which is
better. (1) has the benefit of resolving this case when we are in more
specialized code (a getter function that already knows this is a sub-message
field), and therefore avoids performing the check later in more generic code
that would have to test the type again. On the other hand, the isset() check is
not needed for the pure PHP implementation, as an unset PHP variable will
return `null` anyway. And for the C extension, we'd rather check upb_msg_has()
at the C level instead of PHP.

So this change implements (2). The generated code in wkt.inc remains unchanged,
and the PHP generated code for sub-message fields is changed to remove the
isset() check.
2021-05-27 10:45:18 -07:00
..
ext/google/protobuf Fixed sub-message getters for well-known types when message is unset. 2021-05-27 10:45:18 -07:00
src Fixed sub-message getters for well-known types when message is unset. 2021-05-27 10:45:18 -07:00
tests Fixed sub-message getters for well-known types when message is unset. 2021-05-27 10:45:18 -07:00
composer.json Php & Ruby Cherry Picks for 3.17.1 (#8632) 2021-05-19 15:53:47 -07:00
generate_descriptor_protos.sh Regenerated protos with new script. 2020-10-05 22:27:56 -07:00
generate_test_protos.sh Php & Ruby Cherry Picks for 3.17.1 (#8632) 2021-05-19 15:53:47 -07:00
prepare_c_extension.sh Php & Ruby Cherry Picks for 3.17.1 (#8632) 2021-05-19 15:53:47 -07:00
README.md Update README.md 2021-02-02 09:47:48 -08:00
REFCOUNTING.md Php & Ruby Cherry Picks for 3.17.1 (#8632) 2021-05-19 15:53:47 -07:00
release.sh Use the https address for git clone (#7951) 2020-10-08 14:56:27 -07:00

This directory contains the Protocol Buffers runtime implementation via both a pure PHP package and a native c extension. The pure PHP package is intended to provide usability to wider range of PHP platforms, while the c extension is intended to provide higher performance. Both implementations provide the same runtime APIs and share the same generated code. Users dont need to re-generate code for the same proto definition when they want to switch the implementation later.

Both implementations make use of generated PHP code that defines message and enum types in PHP. We strongly recommend using protoc's PHP generation support with .proto files. The build process in this directory only installs the extension/package; you need to install protoc as well to have PHP code generation functionality.

Requirements

To use PHP runtime library requires:

  • C extension: PHP 7.x, 8.0
  • PHP package: PHP 5.5, 5.6, 7.x, or 8.0.

Installation

C Extension

Prerequirements

To install the c extension, the following tools are needed:

  • autoconf
  • automake
  • libtool
  • make
  • gcc
  • pear
  • pecl

On Ubuntu, you can install them with:

sudo apt-get install -y php-pear php5-dev autoconf automake libtool make gcc

On other platforms, please use the corresponding package managing tool to install them before proceeding.

Installation from Source (Building extension)

To build the c extension, run the following command:

cd ext/google/protobuf
pear package
sudo pecl install protobuf-{VERSION}.tgz

Installation from PECL

When we release a version of Protocol Buffers, we will upload the extension to PECL. To use this pre-packaged extension, simply install it as you would any other extension:

sudo pecl install protobuf-{VERSION}

PHP Package

Installation from composer

Simply add "google/protobuf" to the 'require' section of composer.json in your project.

Protoc

Once the extension or package is installed, if you wish to generate PHP code from a .proto file, you will also want to install the Protocol Buffers compiler (protoc), as described in this repository's main README file. The version of protoc included in the latest release supports the --php_out option to generate PHP code:

protoc --php_out=out_dir test.proto

Usage

For generated code: https://developers.google.com/protocol-buffers/docs/reference/php-generated

Known Issues

  • Missing native support for well known types.
  • Missing support for proto2.
  • No API provided for clear/copy messages.
  • No API provided for encoding/decoding with stream.
  • Map fields may not be garbage-collected if there is cycle reference.
  • No debug information for messages in c extension.
  • HHVM not tested.
  • C extension not tested on windows, mac, php 7.0.
  • Message name cannot be Empty.

Development

Docker Image

We provide a docker image for php development, which is also used in our automatic tests:

docker run --security-opt seccomp=unconfined -it protobuftesting/php_8dbe419c6df1a8b3af0ae3a267c112efb436b45c

Test Native PHP

# Download protobuf
git clone https://github.com/protocolbuffers/protobuf.git
cd protobuf

# Build protoc
./autogen.sh
./configure
make -j4

# Test native php
cd php
composer install
composer test

Test C Extension

After you have finished testing the native php, you can test the c extension:

cd tests
./test.sh 5.6 # The php runtime version.
              # We provide 5.5, 5.5-zts, 5.6, 5.6-zts, 7.0, 7.0-zts, 7.1, 7.1-zts, 7.2, 7.2-zts, 7.3 and 7.3-zts
              # ls /usr/local for more details

If you want to use gdb to debug the c extension, you can do:

./gdb_test.sh