ModelContextProtocol

Serverless handler on Nodejs

xnerhu · 2025-03-25T18:35:27.510Z

Hi. I see there is official SDK for serverless handler, but for Python. I don't see any API for handler in js-sdk.

3

3WaD•3/25/25, 7:32 PM

That's correct. You write the serverless handler in Python.

X

xnerhuOP•3/25/25, 7:58 PM

still, is it possible to use nodejs? I'm not familiar with internal implementation of runpod serverless handler

Xxnerhu still, is it possible to use nodejs? I'm not familiar with internal implementati...

3

3WaD•3/25/25, 10:16 PM

It is. The thing running on the serverless can be whatever you want. You just have to expose it to the RunPod via the handler function in the Python script. The minimal code required is:

import runpod

def handler(job):
  job_input = job["input"] # request parameters sent to RunPod are exposed via this
  # Your code here.
  return "your-job-results"

runpod.serverless.start({"handler": handler})

import runpod

def handler(job):
  job_input = job["input"] # request parameters sent to RunPod are exposed via this
  # Your code here.
  return "your-job-results"

runpod.serverless.start({"handler": handler})

import runpod

def handler(job):
  job_input = job["input"] # request parameters sent to RunPod are exposed via this
  # Your code here.
  return "your-job-results"

runpod.serverless.start({"handler": handler})

import runpod

def handler(job):
  job_input = job["input"] # request parameters sent to RunPod are exposed via this
  # Your code here.
  return "your-job-results"

runpod.serverless.start({"handler": handler})

You can then connect your Nodejs code for example via HTTP API - by running a local server and sending internal requests to it from the Python script:

import requests
import json

def handler(job):
  res = requests.post("http://localhost:3000", json=job["input"])
  return res.json()

import requests
import json

def handler(job):
  res = requests.post("http://localhost:3000", json=job["input"])
  return res.json()

import requests
import json

def handler(job):
  res = requests.post("http://localhost:3000", json=job["input"])
  return res.json()

import requests
import json

def handler(job):
  res = requests.post("http://localhost:3000", json=job["input"])
  return res.json()

Or by spawning a subprocess

import subprocess
import json

def handler(job):
  result = subprocess.run( # use .Popen() for streaming
    ["node", "script.js"],
    input=json.dumps(job["input"]),
    text=True,
    capture_output=True
  )
  return json.loads(result.stdout)

import subprocess
import json

def handler(job):
  result = subprocess.run( # use .Popen() for streaming
    ["node", "script.js"],
    input=json.dumps(job["input"]),
    text=True,
    capture_output=True
  )
  return json.loads(result.stdout)

import subprocess
import json

def handler(job):
  result = subprocess.run( # use .Popen() for streaming
    ["node", "script.js"],
    input=json.dumps(job["input"]),
    text=True,
    capture_output=True
  )
  return json.loads(result.stdout)

import subprocess
import json

def handler(job):
  result = subprocess.run( # use .Popen() for streaming
    ["node", "script.js"],
    input=json.dumps(job["input"]),
    text=True,
    capture_output=True
  )
  return json.loads(result.stdout)

Other methods like Pipes, WebSockets, PubSub or direct TCP exist, but the communication method depends on your needs.

X

xnerhuOP•3/26/25, 8:16 AM

thank you for the example!

S

Sunny•11/4/25, 7:48 AM

Thanks. I made the Node.js server work through a POST request, just as 3WaD suggested.

However, I additionally want to use the progress_update logic — is there a good way to do that?

Thanks again.

Serverless handler on Nodejs

Similar Threads

Similar Threads

Similar Threads