Skip to main content

Google Cloud Pub/Sub

Google Cloud Pub/Sub is a fully managed, asynchronous messaging service that decouples the systems that produce events from the systems that process them. Publishers send messages to topics, and subscribers receive those messages through subscriptions, enabling real-time streaming ingestion, event-driven architectures, and reliable message delivery at scale. Nexla connects to Google Cloud Pub/Sub using OAuth 2.0 authorization through Nexla's registered application.

Google Cloud Pub/Sub icon

Power real-time data operations for your Google Cloud Pub/Sub streams with Nexla. Our Google Cloud Pub/Sub connector makes it easy to ingest, transform, and deliver streaming data anywhere — all in real time and with no coding required. Nexla automatically turns streaming data into ready-to-use data products you can instantly share across projects or combine with batch pipelines. With built-in monitoring, real-time schema validation, and powerful mid-stream transformations — including encryption and PII masking — Nexla keeps your Google Cloud Pub/Sub workflows fast, secure, and fully governed.

Features

Type: Streaming

SourceDestination

  • Simplified Streaming Ingestion: Transform, enrich, and integrate any streaming data for all your AI, analytics, operations projects using a graphical UI or natural language prompts
  • Convert files or batch processes to event streams and vice versa without having to worry about the details.
  • Nexla automatically turns streaming data and other sources into data products using metadata intelligence that are format, protocol, and speed-independent.

Prerequisites​

Before creating a Google Cloud Pub/Sub credential, you need a Google account with access to the Google Cloud project that contains the Pub/Sub topics and subscriptions you want to connect. The connector authenticates using OAuth 2.0 through Nexla's own registered application, so no Google Cloud Console OAuth client setup is required on your part — you authorize access directly from Nexla using your Google account.

The account you authorize must have the appropriate Identity and Access Management (IAM) permissions on the project's Pub/Sub resources. Google Cloud Pub/Sub does not support API key authentication; all requests must be authorized by an authenticated user or principal. During authorization, Nexla requests the https://www.googleapis.com/auth/pubsub scope, which grants access to view and manage Pub/Sub topics and subscriptions on the authorized account's behalf.

To prepare your Google Cloud environment, complete the following steps:

  1. Sign in to the Google Cloud Console with the Google account you intend to authorize.

  2. Select or create the Google Cloud project that contains (or will contain) your Pub/Sub topics and subscriptions from the project selector at the top of the console.

  3. Ensure the Cloud Pub/Sub API is enabled for the project. Navigate to APIs & Services > Library, search for "Cloud Pub/Sub API", and click Enable if it is not already enabled.

  4. Verify that your account has the IAM roles needed for your use case on the relevant Pub/Sub resources. For example, the Pub/Sub Subscriber role (roles/pubsub.subscriber) is required to receive messages, and the Pub/Sub Publisher role (roles/pubsub.publisher) is required to send messages. Roles can be reviewed and assigned under IAM & Admin > IAM.

For detailed information about Pub/Sub authentication, access control, and IAM roles, refer to the Google Cloud Pub/Sub authentication documentation and the Pub/Sub access control documentation.

Authenticate​

Create a credential in Nexla​

  1. After selecting the data source/destination type, click the Add Credential tile to open the Add New Credential overlay.

  2. Enter a name for the credential in the Credential Name field and a short, meaningful description in the Credential Description field.

    The Google Cloud Pub/Sub connector uses OAuth 2.0, which means you authorize Nexla to access your Pub/Sub resources directly through Google's secure authorization flow. Your Google account password is never shared with Nexla.

  3. Click the Authorize button to initiate the OAuth 2.0 authorization flow. A new browser window will open, directing you to the Google sign-in page.

  4. Sign in with the Google account that has access to the Google Cloud project and Pub/Sub resources you want to connect. If you are already signed in to multiple Google accounts, select the appropriate account from the list.

  5. Review the permissions that Nexla is requesting on the Google consent screen, and click Allow to grant access. Google will redirect you back to Nexla once authorization is complete.

    The OAuth 2.0 authorization flow is managed entirely by Google. Nexla does not have access to your Google account password. The authorization grants Nexla a secure, scoped token that allows it to access your Pub/Sub topics and subscriptions on your behalf, using the https://www.googleapis.com/auth/pubsub scope. This access can be revoked at any time by visiting your Google Account permissions page, finding the Nexla application, and selecting Remove Access.

  6. Click the Save button at the bottom of the overlay. The newly added credential will now appear in a tile on the Authenticate screen during data source/destination creation and can be selected for use with a new data source or destination.