Linking issue Ubuntu 22.04 #9063

VinothParamaguru · 2022-05-24T22:30:49Z

VinothParamaguru
May 24, 2022

Hi.

I'm trying to write a test program to use PubSub using google cloud c++ libraries.

I'm facing a linking issue in gRPC (C library) which uses a deprecated openssl function.

/usr/bin/ld: /usr/local/lib/libgrpc.a(ssl_transport_security.cc.o): in function ssl_handshaker_result_extract_peer(tsi_handshaker_result const*, tsi_peer*)': ssl_transport_security.cc:(.text+0x3434): undefined reference to SSL_get_peer_certificate'

Do anyone face the same issue ?

coryan · 2022-05-24T22:50:31Z

coryan
May 24, 2022

FWIW, we test the instructions found here:

https://github.com/googleapis/google-cloud-cpp/blob/main/doc/packaging.md

as part of our CI build. A recent run (just as an example) is here.

We can try to help, but we need a bit more information:

What version of google-cloud-cpp are you trying to build?
Looks like you are not linking the right OpenSSL library for gRPC. Seems like you manually installed gRPC (it is in /usr/local). Is that right? If so, how did you compile gRPC?
Did you follow the instructions at doc/packaging.md?
If not, can you tell us more about how you built google-cloud-cpp and its dependencies?
And finally, what build tool are you using for your own application? Are you using CMake, Make, Bazel, or something else?

0 replies

VinothParamaguru · 2022-05-26T22:46:48Z

VinothParamaguru
May 26, 2022
Author

Hi Coryan

I did follow the same instructions mentioned in here -> https://github.com/googleapis/google-cloud-cpp/blob/main/doc/packaging.md

I used the latest version v1.40.2

I used the following commands to build and install gRPC

mkdir -p $HOME/Downloads/grpc && cd $HOME/Downloads/grpc
curl -sSL https://github.com/grpc/grpc/archive/v1.46.3.tar.gz | \
    tar -xzf - --strip-components=1 && \
    cmake \
        -DCMAKE_BUILD_TYPE=Release \
        -DgRPC_INSTALL=ON \
        -DgRPC_BUILD_TESTS=OFF \
        -DgRPC_ABSL_PROVIDER=package \
        -DgRPC_CARES_PROVIDER=package \
        -DgRPC_PROTOBUF_PROVIDER=package \
        -DgRPC_RE2_PROVIDER=package \
        -DgRPC_SSL_PROVIDER=package \
        -DgRPC_ZLIB_PROVIDER=package \
        -H. -Bcmake-out && \
    cmake --build cmake-out -- -j ${NCPU:-4} && \
sudo cmake --build cmake-out --target install -- -j ${NCPU:-4} && \
sudo ldconfig

I manually installed all the dependencies mentioned under Ubuntu (22.04 LTS - Jammy Jellyfish)

I'm using simple makefiles and trying to get the binaries using the below snippet

GCS_CXXFLAGS := $(shell pkg-config google_cloud_cpp_pubsub --cflags)
GCS_CXXLDFLAGS := $(shell pkg-config google_cloud_cpp_pubsub --libs-only-L)
GCS_LIBS := $(shell pkg-config google_cloud_cpp_pubsub --libs-only-l)

Thanks

0 replies

VinothParamaguru · 2022-05-27T09:53:55Z

VinothParamaguru
May 27, 2022
Author

Looks like SSL_get_peer_certificate() is deprecated on OpenSSL 3.X.X. But my Ubuntu machine installs the same when I tried to install openssl.

2 replies

coryan May 27, 2022

Looks like SSL_get_peer_certificate() is deprecated on OpenSSL 3.X.X. But my Ubuntu machine installs the same when I tried to install openssl.

Using OpenSSL should be Okay. As long as gRPC was also compiled against OpenSSL 3.x. I wrote a test to try to reproduce the problem, but my test works. Maybe you can tell me what did I do wrong so we can iterate and fix the issue?

# syntax=docker/dockerfile:1.3-labs
# test using
#   docker buildx build --progress plain -t test - <Dockerfile

FROM ubuntu:22.04

ENV DEBIAN_FRONTEND=noninteractive
RUN apt-get update && \
    apt-get --no-install-recommends install -y apt-transport-https apt-utils \
        automake build-essential ccache cmake ca-certificates curl git \
        gcc g++ libc-ares-dev libc-ares2 libcurl4-openssl-dev libre2-dev \
        libssl-dev m4 make ninja-build pkg-config tar wget zlib1g-dev

WORKDIR /var/tmp/build/abseil-cpp
RUN curl -sSL https://github.com/abseil/abseil-cpp/archive/20211102.0.tar.gz | \
    tar -xzf - --strip-components=1 && \
    sed -i 's/^#define ABSL_OPTION_USE_\(.*\) 2/#define ABSL_OPTION_USE_\1 0/' "absl/base/options.h" && \
    cmake \
      -DCMAKE_BUILD_TYPE=Release \
      -DBUILD_TESTING=OFF \
      -DBUILD_SHARED_LIBS=yes \
      -DCMAKE_CXX_STANDARD=11 \
      -G Ninja -S . -Bcmake-out && \
    cmake --build cmake-out  && \
    cmake --build cmake-out --target install  && \
    ldconfig

WORKDIR /var/tmp/build/protobuf
RUN curl -sSL https://github.com/protocolbuffers/protobuf/archive/v3.20.1.tar.gz | \
    tar -xzf - --strip-components=1 && \
    cmake \
        -DCMAKE_BUILD_TYPE=Release \
        -DBUILD_SHARED_LIBS=yes \
        -Dprotobuf_BUILD_TESTS=OFF \
        -G Ninja -S cmake -Bcmake-out && \
    cmake --build cmake-out  && \
    cmake --build cmake-out --target install  && \
    ldconfig

WORKDIR /var/tmp/build/grpc
RUN curl -sSL https://github.com/grpc/grpc/archive/v1.46.3.tar.gz | \
    tar -xzf - --strip-components=1 && \
    cmake \
        -DCMAKE_BUILD_TYPE=Release \
        -DgRPC_INSTALL=ON \
        -DgRPC_BUILD_TESTS=OFF \
        -DgRPC_ABSL_PROVIDER=package \
        -DgRPC_CARES_PROVIDER=package \
        -DgRPC_PROTOBUF_PROVIDER=package \
        -DgRPC_RE2_PROVIDER=package \
        -DgRPC_SSL_PROVIDER=package \
        -DgRPC_ZLIB_PROVIDER=package \
        -G Ninja -S . -Bcmake-out && \
    cmake --build cmake-out  && \
    cmake --build cmake-out --target install  && \
    ldconfig

WORKDIR /var/tmp/build/crc32c
RUN curl -sSL https://github.com/google/crc32c/archive/1.1.2.tar.gz | \
    tar -xzf - --strip-components=1 && \
    cmake \
        -DCMAKE_BUILD_TYPE=Release \
        -DBUILD_SHARED_LIBS=yes \
        -DCRC32C_BUILD_TESTS=OFF \
        -DCRC32C_BUILD_BENCHMARKS=OFF \
        -DCRC32C_USE_GLOG=OFF \
        -G Ninja -S . -Bcmake-out && \
    cmake --build cmake-out  && \
    cmake --build cmake-out --target install  && \
    ldconfig

WORKDIR /var/tmp/build/json
RUN curl -sSL https://github.com/nlohmann/json/archive/v3.10.5.tar.gz | \
    tar -xzf - --strip-components=1 && \
    cmake \
      -DCMAKE_BUILD_TYPE=Release \
      -DBUILD_SHARED_LIBS=yes \
      -DBUILD_TESTING=OFF \
      -DJSON_BuildTests=OFF \
      -G Ninja -S . -Bcmake-out/nlohmann/json && \
    cmake --build cmake-out/nlohmann/json --target install  && \
    ldconfig

WORKDIR /var/tmp/build/google-cloud-cpp
RUN curl -sSL https://github.com/googleapis/google-cloud-cpp/archive/v1.40.2.tar.gz | \
    tar -xzf - --strip-components=1 && \
    cmake \
      -DCMAKE_BUILD_TYPE=Release \
      -DBUILD_SHARED_LIBS=yes \
      -DBUILD_TESTING=OFF \
      -DCMAKE_CXX_STANDARD=11 \
      -G Ninja -S . -B cmake-out && \
    cmake --build cmake-out --target install  && \
    ldconfig

RUN ldconfig /usr/local/lib*


WORKDIR /var/tmp/build/test
RUN cat >quickstart.cc <<_EOF_
#include <google/cloud/pubsub/publisher.h>
#include <iostream>
#include <stdexcept>

int main(int argc, char* argv[]) try {
  if (argc != 3) {
    std::cerr << "Usage: " << argv[0] << " <project-id> <topic-id>\n";
    return 1;
  }

  std::string const project_id = argv[1];
  std::string const topic_id = argv[2];

  // Create a namespace alias to make the code easier to read.
  namespace pubsub = ::google::cloud::pubsub;
  auto publisher = pubsub::Publisher(
      pubsub::MakePublisherConnection(pubsub::Topic(project_id, topic_id)));
  auto id =
      publisher
          .Publish(pubsub::MessageBuilder{}.SetData("Hello World!").Build())
          .get();
  if (!id) throw std::runtime_error(id.status().message());
  std::cout << "Hello World published with id=" << *id << "\n";

  return 0;
} catch (std::exception const& ex) {
  std::cerr << "Standard exception raised: " << ex.what() << "\n";
  return 1;
}
_EOF_

RUN cat >Makefile <<'_EOF_'
CXX=g++
CXXLD=$(CXX)
BIN=.

all: $(BIN)/quickstart

# Configuration variables to compile and link against the Cloud Pub/Sub C++
# client library.
PUBSUB_DEPS := google_cloud_cpp_pubsub
PUBSUB_CXXFLAGS   := $(shell pkg-config $(PUBSUB_DEPS) --cflags)
PUBSUB_CXXLDFLAGS := $(shell pkg-config $(PUBSUB_DEPS) --libs-only-L)
PUBSUB_LIBS       := $(shell pkg-config $(PUBSUB_DEPS) --libs-only-l)

# A target using the Cloud Pub/Sub C++ client library.
$(BIN)/quickstart: quickstart.cc
	$(CXXLD) $(CXXFLAGS) $(PUBSUB_CXXFLAGS) $(PUBSUB_CXXLDFLAGS) -o $@ $^ $(PUBSUB_LIBS)
_EOF_

RUN make all
RUN ls -la
RUN ldd ./quickstart

VinothParamaguru May 27, 2022
Author

I tried the same test program in my machine and getting the same error, which means gRPC must have got built using the previously existed openssl libraries . I will remove all the libraries related to openssl and give a try and update you soon.

Thank you very much for the hint

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Linking issue Ubuntu 22.04 #9063

{{title}}

Replies: 3 comments 2 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

Linking issue Ubuntu 22.04 #9063

VinothParamaguru May 24, 2022

Replies: 3 comments · 2 replies

coryan May 24, 2022

VinothParamaguru May 26, 2022 Author

VinothParamaguru May 27, 2022 Author

coryan May 27, 2022

VinothParamaguru May 27, 2022 Author

VinothParamaguru
May 24, 2022

Replies: 3 comments 2 replies

coryan
May 24, 2022

VinothParamaguru
May 26, 2022
Author

VinothParamaguru
May 27, 2022
Author

VinothParamaguru May 27, 2022
Author