HTTP adaptor issue: http posting to localhost instead of using credentials

Adaptors
1

When I run a job that uses the http adaptor and DHIS2 credentials defined in the portal, the HTTP POST is incorrectly made to localhost rather than my DHIS2 server.

This code for the job is here

and this is the error message:

╭─────────────────────────────────────────────╮
│ ◲ ◱  @openfn/core#v1.4.5 (Node.js v14.18.1) │
│ ◳ ◰            @openfn/language-http@3.1.11 │
╰─────────────────────────────────────────────╯
Error: connect ECONNREFUSED 127.0.0.1:80
    at TCPConnectWrap.afterConnect [as oncomplete] (net.js:1159:16) {
  errno: -111,
  code: 'ECONNREFUSED',
  syscall: 'connect',
  address: '127.0.0.1',
  port: 80,
  config: {
    url: '/api/metadata?classKey=ORGANISATION_UNIT',
    method: 'post',
...
2

Hi @dsurrao. Thanks for flagging this.

Could you share the structure of your credentials please (without the values). I want to make sure it uses the same structure as what language-http expect.

When using that adaptor mostly, you should have a baseUrl that should be your base endpoint. An example could typically be like this below:

{
  "username": "myUsername",
  "password": "supersecret",
  "baseUrl": "https://endpoint@instance.com",
  "authType": "digest"
}

and then you could make your different calls to post

post('/api/endpoint1, {...})

post('/api/endpoint2, {...})

Let me know if this helps.

1 Like
3

Also, in case it’s helpful: language-http/Utils.js at b1b4e6fc9079cdfd452d982d5e9f378e806204f4 · OpenFn/language-http · GitHub

Line 5 there shows us how configuration.baseUrl should become a proper url. Pay special attention to the /… looks like you should either have a / in your baseUrl or a / in your path… before “api” here. @Mamadou , wouldn’t it be nice if this adaptor smoothed out / related issues between baseUrl and path automagically? :mage:

Final question for @dsurrao , is this being run on OpenFn.org, or directly using OpenFn/core (or OpenFn/devtools execute or something like that)?

4

@Mamadou, the logs show the following:

auth: {
      username: '....',
      password: '....',
      sendImmediately: true
    }
    ...
   _currentUrl: 'http:/api/metadata?classKey=ORGANISATION_UNIT',

This is a screenshot of the settings I have on OpenFn.org:

dhis2-creds
dhis2-creds1256×1548 77.9 KB

@taylordowns2000 I tried the following combinations of urls with the same result:

  • base url with “/” and “api”
  • base url without “/” and “/api”

This job is being run on OpenFn.org

5

oooh! that’s a dhis2 credential you’re using, not an http credential. you can definitely write a job that works for the http adaptor but uses a dhis2 credential, but you’ll need to do things differently. I’m in transit right now. if @Mamadou doesn’t sort you out in the meantime I can take a peek shortly.

Credentials are how state.configuration gets built on OpenFn.org. There are lots of credential types and they usually match up with adaptor types. They’re quite similar, but just as different systems require different things for authentication, different credentials create different state.configurations

1 Like
6

Got it, thanks! I changed this to an http credential and it worked.

Incidentally, the old configuration of a dhis2 credential used to work, I had successfully run a job on 8/17.

But I’ll use the http credential going forward.

1 Like
7

Interesting. I’d need to check the diff on those various adaptor versions — there may have been more overlap between them earlier, or the urls in the job could have used a full url rather than just a path. Either way, glad you figured it out!

8

Nice here! Sorry @dsurrao I (wrongly) assumed it was run locally and not in openfn.org. But yeah, we might need to document also when to use which type of credential.
@taylordowns2000 thanks for jumping here :slight_smile: To answer your question, yes I think we should handle /in the adaptor to be more rigorous over there in case anyone forget to add it while writing a job.

1 Like
9

Hi @taylordowns2000 or @Mamadou where dou we use the base url after when using the http langage

10

Hello @kamakhady correct me if I am wrong, but I am assuming that you’re running your jobs locally using core (and devtools). If that is the case then I assume that you know about the state json file ? baseUrl1 is a key in the configuration section of your state json file. It allows you to define the base url of the system you wanna communicate with using language-http.

Let’s say you wanna get some data from the system MyAwesomeAPI using the 2 following endpoints: https://myawesomeapi.com/users and https://myawesomeapi.com/posts.

In your state json file you’ll have something like this:

{
  ...
  "baseUrl": "https://myawesomeapi.com",
  ...
}

and then in your expression js file you’ll have your get operations like this

get("/users");

get("/posts");

I hope this will be helpful

11

Yes you are right, I was doing that. Your answer made things more clearer in my head even though I finally had the answer.

1 Like