Jsreport crash when copy folder from local to AWS S3



  • hi sir,

    Can you please tell me that why iam getting the below error,(My jsreport version is 3.1.1)

    Log from aws CloudWatch

    timestamp,message
    1637838049207,"2021-11-25T11:00:49.206Z - info: Initializing jsreport (version: 3.1.1, configuration file: jsreport.config.json, nodejs: 16.11.0)"
    1637838049210,2021-11-25T11:00:49.210Z - info: Searching for available extensions in /app/
    1637838049214,"2021-11-25T11:00:49.213Z - info: Extensions location cache not found, crawling directories"
    1637838050702,2021-11-25T11:00:50.701Z - info: Found 36 extension(s)
    1637838050811,2021-11-25T11:00:50.811Z - debug: Writing extension locations cache to /tmp/jsreport/core/locations.json
    1637838050816,2021-11-25T11:00:50.816Z - debug: Discovered 36 extensions
    1637838051203,2021-11-25T11:00:51.202Z - info: Using extension authentication@3.0.0
    1637838051783,2021-11-25T11:00:51.783Z - debug: Extension authentication@3.0.0 was disabled
    1637838051784,2021-11-25T11:00:51.784Z - info: Using extension base@3.0.0
    1637838051789,2021-11-25T11:00:51.789Z - info: Using extension child-templates@3.0.0
    1637838051791,2021-11-25T11:00:51.791Z - info: Using extension cli@3.0.0
    1637838051796,2021-11-25T11:00:51.795Z - info: Using extension components@3.0.1
    1637838051797,2021-11-25T11:00:51.797Z - info: Using extension data@3.0.0
    1637838051798,2021-11-25T11:00:51.798Z - info: Using extension express@3.1.0
    1637838052723,2021-11-25T11:00:52.723Z - info: Using extension freeze@3.0.1
    1637838052745,2021-11-25T11:00:52.745Z - info: Using extension fs-store@3.0.0
    1637838053090,2021-11-25T11:00:53.089Z - info: Using extension handlebars@3.0.0
    1637838053106,2021-11-25T11:00:53.106Z - info: Using extension import-export@3.0.1
    1637838053135,2021-11-25T11:00:53.135Z - info: Using extension jsrender@3.0.0
    1637838053136,2021-11-25T11:00:53.136Z - info: Using extension licensing@3.0.1
    1637838053204,2021-11-25T11:00:53.194Z - info: Using extension localization@3.0.1
    1637838053212,2021-11-25T11:00:53.206Z - info: Using extension npm@3.0.1
    1637838053216,2021-11-25T11:00:53.215Z - info: Using extension pdf-utils@3.0.2
    1637838053217,2021-11-25T11:00:53.217Z - info: Using extension reports@3.0.0
    1637838053220,2021-11-25T11:00:53.220Z - info: Using extension tags@3.0.0
    1637838053221,2021-11-25T11:00:53.221Z - info: Using extension text@3.0.0
    1637838053222,2021-11-25T11:00:53.222Z - info: Using extension version-control@3.0.1
    1637838053285,2021-11-25T11:00:53.284Z - info: Using extension assets@3.0.1
    1637838053295,2021-11-25T11:00:53.295Z - info: Using extension authorization@3.0.2
    1637838053300,2021-11-25T11:00:53.300Z - debug: Extension authorization@3.0.2 was disabled
    1637838053383,2021-11-25T11:00:53.383Z - info: Using extension browser-client@3.0.1
    1637838053386,2021-11-25T11:00:53.385Z - info: Using extension chrome-pdf@3.0.0
    1637838053388,"2021-11-25T11:00:53.388Z - debug: Chrome strategy is chrome-pool, numberOfWorkers: 1"
    1637838053389,"2021-11-25T11:00:53.389Z - debug: Chrome custom launch options are executablePath=/usr/lib/chromium/chrome, args=--no-sandbox,--disable-dev-shm-usage"
    1637838053390,2021-11-25T11:00:53.390Z - info: Using extension docx@3.0.1
    1637838053392,2021-11-25T11:00:53.392Z - info: Using extension fs-store-aws-s3-persistence@3.0.1
    1637838053792,2021-11-25T11:00:53.792Z - info: Using extension html-to-xlsx@3.0.1
    1637838054088,2021-11-25T11:00:54.088Z - info: html-to-xlsx detected chrome as available html engine
    1637838054088,2021-11-25T11:00:54.088Z - info: Using extension pptx@3.0.2
    1637838054090,2021-11-25T11:00:54.090Z - info: Using extension scheduling@3.0.1
    1637838054195,2021-11-25T11:00:54.195Z - info: Using extension scripts@3.0.1
    1637838054196,2021-11-25T11:00:54.196Z - info: Using extension static-pdf@3.0.0
    1637838054197,2021-11-25T11:00:54.197Z - info: Using extension studio@3.1.0
    1637838054597,2021-11-25T11:00:54.597Z - info: Using extension xlsx@3.0.1
    1637838054688,2021-11-25T11:00:54.688Z - info: Using extension public-templates@3.0.0
    1637838054689,2021-11-25T11:00:54.689Z - debug: Extension public-templates@3.0.0 was disabled
    1637838054690,2021-11-25T11:00:54.690Z - info: Using extension sample-template@3.1.0
    1637838054692,2021-11-25T11:00:54.692Z - info: Using extension studio-theme-dark@3.0.0
    1637838054693,2021-11-25T11:00:54.693Z - info: Using general timeout for rendering (reportTimeout: 60000)
    1637838054693,2021-11-25T11:00:54.693Z - info: Using fs provider for template store.
    1637838054701,2021-11-25T11:00:54.701Z - info: fs store is persisting using aws-s3 for /app/data
    1637838054908,2021-11-25T11:00:54.908Z - info: fs store is verifying aws s3 bucket jsreportbucket exists and is accessible
    1637838055116,2021-11-25T11:00:55.116Z - info: fs store is verifying SQS for locking in us-east-1 with name jsreport-lock.fifo
    1637838059035,2021-11-25T11:00:59.032Z - info: fs store is loading data
    1637838109055,2021-11-25T11:01:49.055Z - info: fs store is initialized successfully
    1637838109083,2021-11-25T11:01:49.083Z - debug: studio default theme is: light
    1637838111401,"2021-11-25T11:01:51.401Z - debug: Running migration ""resourcesToAssets"""
    1637838111487,"2021-11-25T11:01:51.487Z - debug: Migration ""resourcesToAssets"" finished"
    1637838174340,"2021-11-25T11:02:54.340Z - error: copy consistent transaction to the data directory crashed, trying again in 200ms The specified key does not exist. code=NoSuchKey, region=null, time=Thu Nov 25 2021 11:02:54 GMT+0000 (Coordinated Universal Time), requestId=9QGVXXW2F24TG16K, extendedRequestId=PDJ0N4NpC+O62qSsdrEGZ6Vz3jJR5LgKHCyA0g7mnmRtQvSvk0qvK25IamTLDElrEC3wI2F+I5k=, cfId=undefined, statusCode=404, retryable=false, retryDelay=33.69458455368357, stack=NoSuchKey: The specified key does not exist."
    1637838174340, at Request.extractError (/app/node_modules/aws-sdk/lib/services/s3.js:585:35)
    1637838174340, at Request.callListeners (/app/node_modules/aws-sdk/lib/sequential_executor.js:106:20)
    1637838174340, at Request.emit (/app/node_modules/aws-sdk/lib/sequential_executor.js:78:10)
    1637838174340, at Request.emit (/app/node_modules/aws-sdk/lib/request.js:683:14)
    1637838174340, at Request.transition (/app/node_modules/aws-sdk/lib/request.js:22:10)
    1637838174340, at AcceptorStateMachine.runTo (/app/node_modules/aws-sdk/lib/state_machine.js:14:12)
    1637838174340, at /app/node_modules/aws-sdk/lib/state_machine.js:26:10
    1637838174340, at Request.<anonymous> (/app/node_modules/aws-sdk/lib/request.js:38:9)
    1637838174340, at Request.<anonymous> (/app/node_modules/aws-sdk/lib/request.js:685:12)
    1637838174340, at Request.callListeners (/app/node_modules/aws-sdk/lib/sequential_executor.js:116:18)
    1637838174411,"2021-11-25T11:02:54.411Z - warn: Error when syncing fs journal, no worry, we will run again Timeout during waiting for file system, try it again later. stack=Error: Timeout during waiting for file system, try it again later."
    1637838174411, at Object.rejectItemsWithTimeout (/app/node_modules/@jsreport/jsreport-fs-store/lib/queue.js:52:23)
    1637838174411, at Timeout._onTimeout (/app/node_modules/@jsreport/jsreport-fs-store/lib/transaction.js:22:11)
    1637838174411, at listOnTimeout (node:internal/timers:557:17)
    1637838174411, at processTimers (node:internal/timers:500:7)
    1637838178005,"2021-11-25T11:02:58.005Z - error: copy consistent transaction to the data directory crashed, trying again in 400ms The specified key does not exist. code=NoSuchKey, region=null, time=Thu Nov 25 2021 11:02:58 GMT+0000 (Coordinated Universal Time), requestId=6XZTW82J2DVVCQTR, extendedRequestId=AWlkaym/fHlcOydreeqJhVVxQp14HJmndZjCiL7R7L7XLg1pt6KJ3Kv/A+m7Rd2F8HG5nkDFVWI=, cfId=undefined, statusCode=404, retryable=false, retryDelay=32.09736090280264, stack=NoSuchKey: The specified key does not exist."
    1637838178005, at Request.extractError (/app/node_modules/aws-sdk/lib/services/s3.js:585:35)
    1637838178005, at Request.callListeners (/app/node_modules/aws-sdk/lib/sequential_executor.js:106:20)
    1637838178005, at Request.emit (/app/node_modules/aws-sdk/lib/sequential_executor.js:78:10)
    1637838178005, at Request.emit (/app/node_modules/aws-sdk/lib/request.js:683:14)
    1637838178005, at Request.transition (/app/node_modules/aws-sdk/lib/request.js:22:10)
    1637838178005, at AcceptorStateMachine.runTo (/app/node_modules/aws-sdk/lib/state_machine.js:14:12)
    1637838178005, at /app/node_modules/aws-sdk/lib/state_machine.js:26:10
    1637838178005, at Request.<anonymous> (/app/node_modules/aws-sdk/lib/request.js:38:9)
    1637838178005, at Request.<anonymous> (/app/node_modules/aws-sdk/lib/request.js:685:12)
    1637838178005, at Request.callListeners (/app/node_modules/aws-sdk/lib/sequential_executor.js:116:18)

    1637838208613,2021-11-25T11:03:28.612Z - info: Creating default express app.
    1637838208692,2021-11-25T11:03:28.691Z - info: jsreport server successfully started on http port: 8084
    1637838208695,2021-11-25T11:03:28.694Z - info: Verifying license key free
    1637838209327,2021-11-25T11:03:29.326Z - info: Starting one month enterprise trial



  • I appologize for your trouble.

    Unfortunately, I'm not able to replicate this.
    It would help me a lot if you would share with me the content of your bucket.
    Would you be able to download it and email it to me? jan.blaha@jsreport.net


Log in to reply
 

Looks like your connection to jsreport forum was lost, please wait while we try to reconnect.