Utkarsh Shigihalli

Posted on Feb 26, 2021 • Originally published at visualstudiogeeks.com on Dec 28, 2020

Deploying TIBCO Rendezvous on RedHat Enterprise Linux using Azure DevOps

#tibco #azuredevops #devops

TIBCO Rendezvous (RDV) is one of the popular messaging product for real-time data processing. Predominantly used in Financial corporations to process real-time trading, market data and efficient information flow between control systems. In this post, we will see how we can deploy this messaging application to RedHat Enterprise Linux (RHEL) 7 (on Azure VM) using Azure DevOps.

Source: https://www.tibco.com/products/tibco-rendezvous

For this post, we are assuming that we have a RHEL VM provisioned on Azure to which we are going to deploy. Also, the installers are downloaded published to Azure Artifacts as an Universal Package.

Create SSH service connection in Azure DevOps

The first step is to ensure Azure DevOps can connect to our VM in Azure. For that, we set up a service connection in Azure DevOps. Since its Linux VM, we use SSH connection. Detailed steps of creating the SSH service connection are here

Create deployment pipeline

To summarize, the steps for deployment are

Download and extract the installer from Azure Artifacts
Install required pre-requisites
Copy the installer to VM
Adjust the install path in TIBCO Rendezvous response file
Set the execute permission on the installer so that we can run the installer
Delete any existing instance of the RDV, so that we can trigger this pipeline again without any manual changes.
Install TIBCO Rendezvous
Add installer file to ~/.bash_profile
Set execute permissions and start the service.

1. Download and extract the installer from Azure Artifacts

We use Universal Package task from Azure DevOps.

steps:
- task: UniversalPackages@0
  displayName: download rdv package from artifacts
  inputs:
    command: 'download'
    downloadDirectory: '$(system.artifactsdirectory)'
    feedsToUse: 'internal'
    vstsFeed: 'Demo/my-artifacts'
    vstsFeedPackage: 'tibco-rdv'
    vstsPackageVersion: '8.4.5'

2. Install required pre-requisites

We then install any required pre-requisites needed on the machine. Here we are installing Java 1.8, GNU C Library. Notice that we are using SSH task so that these commands are run on the VM we are deploying to. We use the service connection created above and passing that as a parameter to this pipeline YAML. Azure DevOps has a powerful templating feature for YAML pipelines, and here I am using a template. So I am using ${{ }} syntax. More on this expression is here.

- task: SSH@0
  displayName: 'install prerequisites'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: |
        sudo yum -y install java-1.8.0-openjdk.x86_64
        sudo yum -y install glibc.x86_64
    readyTimeout: '20000'

3. Copy the installer to VM

Next we need to copy the installer files to VM. We again do that using CopyFilesOverSSH task in Azure DevOps.

- task: CopyFilesOverSSH@0
displayName: 'copy tibco rvd installer files to machine'
inputs:
  sshEndpoint: '$'
  sourceFolder: '$(system.artifactsdirectory)/out'
  contents: '**'
  targetFolder: '/data/tibco-rdv/'
  readyTimeout: '20000'

4. Adjust the install path in TIBCO Rendezvous response file

Since we are deploying TIBCO Rendezvous in our CD pipeline, we need to install using non-interactive (or silent) mode. TIBCO provides a response file (TIBCOUniversalInstaller-rv.silent) along with installer. This response file can be edited to select all the configurations (like Install path, home directory etc) for the installer. We are using simple SSH task and running few sed commands to replace the path according to our needs in the response file.

- task: SSH@0
displayName: 'adjust response silent file'
inputs:
  sshEndpoint: '$'
  runOptions: 'commands'
  commands: |
      sed -i 's/\/opt\/tibco/\/opt\/tibco\/rdv/g' /data/tibco-rdv/TIBCOUniversalInstaller-rv.silent
      sed -i 's/TIBCO-HOME/TIBCO-RDV-HOME/g' /data/tibco-rdv/TIBCOUniversalInstaller-rv.silent
  readyTimeout: '20000'

5. Set the execute permission on the installer so that we can run the installer

Before we run the installer, we need to ensure that the user running it (in our case the credentials used while creating the service connection) has execute permissions. So we set the execute permissions for the installer file.

- task: SSH@0
  displayName: 'set execute permissions'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: 'chmod a+x /data/tibco-rdv/TIBCOUniversalInstaller-lnx-x86.bin'
    readyTimeout: '20000'

6. Delete any existing instance of the RDV

Also, before we install the service, we need to remove any existing services running, This will also enable to run this pipeline again and again without manually configuring something in the VM.

- task: SSH@0
  displayName: 'delete previous instance'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: |
        pkill 'rvd64'
        sudo rm -rf /opt/tibco/rdv/*
    readyTimeout: '20000'

7. Install TIBCO Rendezvous

Next, we start the installation by executing installer file.

- task: SSH@0
  displayName: 'install tibco rdv'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: 'sudo /data/tibco-rdv/TIBCOUniversalInstaller-lnx-x86.bin -silent -V responseFile=/data/tibco-rdv/TIBCOUniversalInstaller-rv.silent -is:javahome $(dirname $(dirname $(readlink $(readlink $(which java))))) -is:log "$(build.buildnumber).log"'
    readyTimeout: '20000'

Notice we pass the modified response file to the installer so that it can without any manual interaction.

8. Add installer file to `~/.bash_profile`

Next, we need to add install path to ~/.bash_profile so that its available from anywhere.

- task: SSH@0
  displayName: 'update bash profile'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: |
        cp ~/.bash_profile ~/.bash_profile.tmp
        echo 'export PATH=$PATH:/opt/tibco/rdv/tibrv/8.4/bin' >> ~/.bash_profile
        echo 'export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/tibco/rdv/tibrv/8.4/lib' >> ~/.bash_profile
    readyTimeout: '20000'

In the above step, I am just backing up existing ~/.bash_profile file. A better way probably is to find and replace the values (to avoid duplicates) which I am planning to do in the future

9. Set execute permissions and start the service.

Final step is to start the Rendezvous service itself. Before that we need to set the execute permissions for the file. So our YAML looks as below.

- task: SSH@0
  displayName: 'set execute permissions'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: 'sudo chmod a+x /opt/tibco/rdv/tibrv/8.4/bin/rvd64'
    readyTimeout: '20000'

- task: SSH@0
  displayName: start the rvd service
  timeoutInMinutes: 2
  continueOnError: true
  inputs:
    sshEndpoint: '$'
    runOptions: 'inline'
    inline: |
        /opt/tibco/rdv/tibrv/8.4/bin/rvd64 -listen 8500
        sleep 70
        exit
    readyTimeout: '20000'

Notice in the last step, we have enabled continueOnError: true. For some reason, when you start the service, its not ending the console. There must be an option in the response file to properly start the service, but I am yet to figure it out.

Final YAML template

# template file to deploy tibco rendezvous

parameters:
  - name: sshEndPoint
    type: string
    default: ''

steps:
- task: UniversalPackages@0
  displayName: download rdv package from artifacts
  inputs:
    command: 'download'
    downloadDirectory: '$(system.artifactsdirectory)'
    feedsToUse: 'internal'
    vstsFeed: 'Demo/my-artifacts'
    vstsFeedPackage: 'tibco-rdv'
    vstsPackageVersion: '8.4.5'

- script: |
    unzip -oq $(system.artifactsdirectory)/TIB_rv_8.4.5_linux_x86.zip -d $(system.artifactsdirectory)/out
  displayName: 'extract files'

- task: SSH@0
  displayName: 'install prerequisites'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: |
        sudo yum -y install java-1.8.0-openjdk.x86_64
        sudo yum -y install glibc.x86_64
    readyTimeout: '20000'

- task: CopyFilesOverSSH@0
  displayName: 'copy tibco rvd installer files to machine'
  inputs:
    sshEndpoint: '$'
    sourceFolder: '$(system.artifactsdirectory)/out'
    contents: '**'
    targetFolder: '/data/tibco-rdv/'
    readyTimeout: '20000'

- task: SSH@0
  displayName: 'adjust response silent file'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: |
        sed -i 's/\/opt\/tibco/\/opt\/tibco\/rdv/g' /data/tibco-rdv/TIBCOUniversalInstaller-rv.silent
        sed -i 's/TIBCO-HOME/TIBCO-RDV-HOME/g' /data/tibco-rdv/TIBCOUniversalInstaller-rv.silent
    readyTimeout: '20000'                

- task: SSH@0
  displayName: 'set execute permissions'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: 'chmod a+x /data/tibco-rdv/TIBCOUniversalInstaller-lnx-x86.bin'
    readyTimeout: '20000'

- task: SSH@0
  displayName: 'delete previous instance'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: |
        pkill 'rvd64'
        sudo rm -rf /opt/tibco/rdv/*
    readyTimeout: '20000'

- task: SSH@0
  displayName: 'install tibco rdv'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: 'sudo /data/tibco-rdv/TIBCOUniversalInstaller-lnx-x86.bin -silent -V responseFile=/data/tibco-rdv/TIBCOUniversalInstaller-rv.silent -is:javahome $(dirname $(dirname $(readlink $(readlink $(which java))))) -is:log "$(build.buildnumber).log"'
    readyTimeout: '20000'        

- task: SSH@0
  displayName: 'update bash profile'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: |
        cp ~/.bash_profile ~/.bash_profile.tmp
        echo 'export PATH=$PATH:/opt/tibco/rdv/tibrv/8.4/bin' >> ~/.bash_profile
        echo 'export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/tibco/rdv/tibrv/8.4/lib' >> ~/.bash_profile
    readyTimeout: '20000'

- task: SSH@0
  displayName: 'set execute permissions'
  inputs:
    sshEndpoint: '$'
    runOptions: 'commands'
    commands: 'sudo chmod a+x /opt/tibco/rdv/tibrv/8.4/bin/rvd64'
    readyTimeout: '20000'

- task: SSH@0
  displayName: start the rvd service
  timeoutInMinutes: 2
  continueOnError: true
  inputs:
    sshEndpoint: '$'
    runOptions: 'inline'
    inline: |
        /opt/tibco/rdv/tibrv/8.4/bin/rvd64 -listen 8500
        sleep 70
        exit
    readyTimeout: '20000'

Conclusion

That’s it, you now know how we implemented Azure DevOps pipeline to deploy TIBCO Rendezvous 🥳

DEV Community

Deploying TIBCO Rendezvous on RedHat Enterprise Linux using Azure DevOps

Create SSH service connection in Azure DevOps

Create deployment pipeline

1. Download and extract the installer from Azure Artifacts

2. Install required pre-requisites

3. Copy the installer to VM

4. Adjust the install path in TIBCO Rendezvous response file

5. Set the execute permission on the installer so that we can run the installer

6. Delete any existing instance of the RDV

7. Install TIBCO Rendezvous

8. Add installer file to `~/.bash_profile`

9. Set execute permissions and start the service.

Final YAML template

Conclusion

Top comments (0)

Read next

5 Steps to Building a Robust Cyber Resilience Framework

Deploy serverless Lambda TypeScript API with function url using AWS CDK

Unlocking the Power of Static Pods in Kubernetes: A Beginner's Guide

Managing EKS Add-ons with Terraform

Create SSH service connection in Azure DevOps

Create deployment pipeline

1. Download and extract the installer from Azure Artifacts

2. Install required pre-requisites

3. Copy the installer to VM

4. Adjust the install path in TIBCO Rendezvous response file

5. Set the execute permission on the installer so that we can run the installer

6. Delete any existing instance of the RDV

7. Install TIBCO Rendezvous

8. Add installer file to ~/.bash_profile

9. Set execute permissions and start the service.

Final YAML template

Conclusion

Read next

5 Steps to Building a Robust Cyber Resilience Framework

Deploy serverless Lambda TypeScript API with function url using AWS CDK

Unlocking the Power of Static Pods in Kubernetes: A Beginner's Guide

Managing EKS Add-ons with Terraform

8. Add installer file to `~/.bash_profile`