DEV Community

Cover image for Laravel log stream to Kibana Elasticsearch Monolog
Tahsin Ahmed
Tahsin Ahmed

Posted on

Laravel log stream to Kibana Elasticsearch Monolog

ELK ( Elasticsearch, Logdash, and Kibana) is one of the popular log management platforms for log analysis. But for this project I will be using Laravel Monolog for handling the logs instead of Logdash.
Before getting into coding let’s know a little about the platforms.

Monolog :

Monolog is a PHP logging library that’s included in Laravel. This library is widely customizable and used because of the easy handle management and it provides build in handler that can easily help anyone to send logs to multiple destinations.
Here’s Monolog source code and Laravel documentation for monolog.

Elasticsearch :

Elasticsearchis a free and open-source analytics and search engine that returns and stores data in the JSON index format. Users may easily store, search and analyze huge quantities of data thanks to this engine. Because it uses an index rather than directly querying the text data, it is able to respond to search results in milliseconds. Simply put, Elasticsearchfunctions as a server that can handle JSON queries and return JSON information.


Kibana is a visual interface tool that lets you work with log data that has been mass-stored in Elasticsearch clusters to explore, visualize, and generate reports. Kibana's primary functionalities are data analysis and querying. Furthermore, you may see data in several ways with Kibana's visualization tools by utilizing heat maps, line graphs, pie charts, histograms, and geospatial support. You can look for root cause diagnostics in the data stored in Elasticsearch using a variety of techniques.
Kibana documentation

Ok!! Let's start coding

Step 01: Run Kibana and Elasticsearch with docker

I am using docker to run Laravel , Kibana, Elasticsearch . I hope you already know how to run Laravelprojects in docker. For Kibana and Elasticsearch, Here's my docker-compose code: -

    image: kibana:8.11.1
    container_name : kibana_container
      - "5601:5601"
      ELASTICSEARCH_HOSTS: http://elasticsearch:9200
      ELASTICSEARCH_URL: http://elasticsearch:9200
      - laravel
    image: elasticsearch:8.11.1
    container_name: elasticsearch_container
      - "9200:9200"
      - discovery.type=single-node # To run single node 
      - # To remove SSL complexity
      - "ES_JAVA_OPTS=-Xms512m -Xmx512m"
        soft: -1
        hard: -1
      - "./elk-data:/usr/share/elasticsearch/data"

      - laravel
Enter fullscreen mode Exit fullscreen mode

PS : I am keeping all my container in laravelnetwork.
Now docker-compose up --build to see Kibanaand Elasticsearch is up and running.
Elasticsearch will run on : http://localhost:9200/
Kibana will run on : http://localhost:5601/

Step 02: Setup env file

In .env add this lines:

Enter fullscreen mode Exit fullscreen mode

Step 03: Create config file

Create a config file inside config/elastic_log.php . Write this in that file


return [
    'host' => env('ELASTIC_HOST'),
    'index' => 'laravel_logs',
    'prefix' => 'api',
    'type' => '_doc',
Enter fullscreen mode Exit fullscreen mode

Step 04: Create ElasticLog Provider

Create a Laravel provider with this command

php artisan make:provider ElasticlogProvider 
Enter fullscreen mode Exit fullscreen mode

and put this block of code inside boot function

        $index = rtrim(config('elastic_log.prefix'), '_') . '_' . config('elastic_log.index');
        $type = config('elastic_log.type');

        $this->app->bind(Client::class, function ($app) {
            return ClientBuilder::create()->setHosts([config('')])->setHttpClient(new HttpClient(['verify' => false]))->build();

        $this->app->bind(ElasticsearchFormatter::class, function ($app) use ($index, $type) {
            return new ElasticsearchFormatter($index, $type);

        $this->app->bind(ElasticsearchHandler::class, function ($app) use ($index, $type) {
            return new ElasticsearchHandler($app->make(Client::class), [
                'index'        => $index,
                'type'         => $type,
                'ignore_error' => false,
Enter fullscreen mode Exit fullscreen mode

Step 04: Create Log channel

In config/logging.php add a new monolog channel named elastic under channels array

'elastic' => [
            'driver' => 'monolog',
            'handler' => ElasticsearchHandler::class,
            'level' => 'debug',
            'formatter' => ElasticsearchFormatter::class,
Enter fullscreen mode Exit fullscreen mode

Step 05: Create a custom command

Create a Laravel custom command with

php artisan make:command ElasticLogSetup
Enter fullscreen mode Exit fullscreen mode

In handle function add this :

$index = rtrim(config('elastic_log.prefix'), '_') . '_' . config('elastic_log.index');

if (!$this->client->indices()->exists(['index' => $index])) {
                'index' => $index,
Enter fullscreen mode Exit fullscreen mode

Make sure to change the signature of the command :

   protected $signature = 'elastic:log_setup';
Enter fullscreen mode Exit fullscreen mode

Now run the command :

php artisan elastic:log_setup 
Enter fullscreen mode Exit fullscreen mode

Step 06: Add view data for viewing in Kibana

Check the Kibana container is running. If it's working go to

Enter fullscreen mode Exit fullscreen mode

And add the api_laravel_logs index into view

Kibana Dashboard Image


Kibana now set up with Laravel project, You can stream logs with default Laravel Log facade.

Thank you !!!

Resources :

Top comments (0)