CA
Crawlee & Apify•3y ago
xenial-black

How to extend log messages?

Are there any plans to extend Crawlee logger? Ref: https://crawlee.dev/api/core/class/Logger I found this to set the skipTime option 
const Apify = require('apify');

const { utils: { log } } = Apify;

log.setOptions({
    logger: new log.LoggerText({ skipTime: false }),
});
const Apify = require('apify');

const { utils: { log } } = Apify;

log.setOptions({
    logger: new log.LoggerText({ skipTime: false }),
});
but it doesn't seem to work. I got Uncaught TypeError TypeError: Cannot read properties of undefined (reading 'log') My code: 
import Apify from 'apify'
const { utils: { log } } = Apify;

log.setOptions({
    logger: new log.LoggerText({ skipTime: false }),
});

// https://crawlee.dev/api/playwright-crawler/class/PlaywrightCrawler
const crawler = new PlaywrightCrawler(
    launchContext: {
        launchOptions: {
            headless: true,
            stealth: true,
            viewport: { width:600, height:300 }
        },
    },
    async requestHandler({ request, page, enqueueLinks, log }) {
        const title = await page.title();
        log.info(`Titre: ${title} Url: ${request.loadedUrl}`);
    }
import Apify from 'apify'
const { utils: { log } } = Apify;

log.setOptions({
    logger: new log.LoggerText({ skipTime: false }),
});

// https://crawlee.dev/api/playwright-crawler/class/PlaywrightCrawler
const crawler = new PlaywrightCrawler(
    launchContext: {
        launchOptions: {
            headless: true,
            stealth: true,
            viewport: { width:600, height:300 }
        },
    },
    async requestHandler({ request, page, enqueueLinks, log }) {
        const title = await page.title();
        log.info(`Titre: ${title} Url: ${request.loadedUrl}`);
    }
Logger | API | Crawlee
This is an abstract class that should be extended by custom logger classes. this._log() method must be implemented by them.
1 Reply
fascinating-indigo
fascinating-indigo•3y ago
The reason is because utils is no longer exported from the apify package, therefore it is undefined. That's why you get the error of Cannot read 'log' of undefined. log doesn't exist on undefined. Instead, you should import log from crawlee like this: 
import { log, LoggerText } from 'crawlee';

log.setOptions({
    logger: new LoggerText({ skipTime: false }),
});
import { log, LoggerText } from 'crawlee';

log.setOptions({
    logger: new LoggerText({ skipTime: false }),
});

Did you find this page helpful?