Tracking: Collaboration with other Node.js Micropub projects about webpage-micropub-to-github HOT 12 OPEN

Excellent idea! I'm all for it!

I don't know if you've mentioned them already but I've talked with @EdwardHinkle and @martymcguire about a similar idea of having express middleware to do generic things.

I'm also the proud owner of the @indieweb organization on mom if we ever get to a stage where we have something were happy to publish as a group.

As for relation to my current personal projects, I have a few endpoints I have made - mainly a micropub endpoint, webmention endpoint and token endpoint. The majority of the code it fairly resuable but not 100% designed as npm modules. The goal for my project is to be a fairly feature complete, fully extendable indieweb backend with the frontend totally independent. I would love if it was usable with static sites but that is not my main goal.

In my indieweb dreams I would love to have a bunch of reusable endpoints / modules to cover a range on indieweb functionality. Mainly from the top of my head:

• micropub
• tokens
• auth
• webmention accept
• webmention send (I think there is already a good implementation of this)
• post type discovery
• format conversion (mf2 to jf2 to md frontmatter etc)
• maybe url parsing (basically mf2 html parser + other metadata fallback)

That's about all I can think of for now on my phone but I'm sure there is much more

from webpage-micropub-to-github.

Forgot media endpoint

from webpage-micropub-to-github.

Micropub Endpoints

So I've done a quick look into the various js based micropub endpoints and here is what I have found them to support based on micropub.rocks tests. (note this absolutely may be missing projects or features of each project)

Other projects I looked at:

• EdwardHinkle/abode but looks like it is based on voxpelli/node-micropub-express
• astillanet/micropub-node-parser - very very basic
• sa-mm/micropub_server - Appears to use voxpelli/node-micropub-express with graphql
• joshdick/microstat - Uses voxpelli/node-micropub-express and voxpelli/node-format-microformat to create markdown files
• am1t/blotpub - Uses a fork of voxpelli/node-micropub-express to talk to dropbox or blot.im
• vipickering/mastr-cntrl - Looks very constrained per post type

#humblebrag - definitely looks like my own endpoint is the most feature complete, but that definitely doesn't make it the best option.

from webpage-micropub-to-github.

I think this is a great effort. Mine (abode) is currently using voxpelli/Node-Micropub-express as grant mentioned. I have been planning on building one from scratch so this effort would definitely help on preventing me from re-inventing the wheel. A couple important aspects in my mind:

• the output of the Middleware Library shouldn’t try to do anything fancy. It should output standard MF2 JSON and then individual libraries that use the Micropub Endpoint base can convert the mf2 JSON to whatever is needed.

• support for Update and Delete are definitely essential for me.

Some other thoughts:

• it would be useful if we have the Micropub Endpoint take either a Token Endpoint Url OR a function. This would allow for hard-coding tokens or other internal integrations.

Ultimately though, I think it would be amazing if we were able to all contribute to Node.js libraries in npm that allowed for customizable/extensionable integration into other apps.

Also I don’t know how much of you all use TypeScript but adding TypeScript support to them as well would be pretty great.

from webpage-micropub-to-github.

I agree with @EdwardHinkle

The endpoint should definitely just pass through mf2 json, and should at least be able to handle all of those tests from micropub.rocks I listed above.

Another couple of notes on what a shared endpoint could potentially handle:

• It should be able to handle scopes and reject if not sufficient
• Should validate mf2 and reject if invalid (just basic stuff like properties should be arrays)
• Handle media. This is a bit more complicated, but I think this should also provide a media endpoint that can be set to just store to a folder, but then also be extendable with a function to handle files or pass them to an external media endpoint

The only thing I am not sure I agree with is TypeScript, I think TypeScript is great but if it is a community project it is just one extra thing that someone would have to learn before being able to contribute.

from webpage-micropub-to-github.

Another thing I'd like to see decided prior to starting any development would be about the actual method of using the library.

For now voxpelli/node-micropub-express uses a object to configure the endpoint:

const micropub = require('micropub-express');

app.use('/micropub', micropub({
  tokenReference: {
    me: 'http://example.com/',
    endpoint: 'https://tokens.indieauth.com/token',
  },
  handler: async (micropubDocument, req) => ({ url: 'http://example.com/url/to/new/post' })
}));

But the other options is to use methods, more like how express actually works:

const Micropub = require('micropub-express');
const micropub = Micropub();

micropub.handler(async (micropubDocument, req) => ({ url: 'http://example.com/url/to/new/post' });

micropub.setTokenReference({
  me: 'http://example.com/',
  endpoint: 'https://tokens.indieauth.com/token',
});

app.use('/micropub', micropub.router);

Note: just examples, not suggesting any sort of vocabulary.

Personally I think I prefer using the methods, but I am not 100% sure of the pros and cons

from webpage-micropub-to-github.

from webpage-micropub-to-github.

happy summer friends. Wondering if there's been further discussion on this and getindiekit/indiekit#1 (comment)

I'm eerily close to moving back to Jekyll and assessing the landscape. I'm a big fan of everyone's work.

from webpage-micropub-to-github.

@miklb I don't think there's been much extra discussion elsewhere yet. But I'd be keen to get started on something soon. Particularly on micropub, token and auth endpoints.

I think there are already at least a couple of express token endpoints out there that are pretty much done.

For micropub the projects mentioned above are all good, but handle things differently, but a new higher level module could probably be put together using some of the best parts from each.

As for auth, I don't think there is much built so far that would be easily reusable.

But I am not really sure what would be a best starting point. Maybe a new repo with a project that lays out a bit of a road map?

from webpage-micropub-to-github.

I went ahead and made a new repo specifically for micropub endpoint planning: https://github.com/grantcodes/future-micropub-endpoint

from webpage-micropub-to-github.

@miklb You asked this question at just the right time; I had not been working on IndieKit since March, but started looking at it again this month, so it’s very much front of mind.

I’m excited by the moves @grantcodes has made to elicit collaboration among different project authors, and will start responding with my thoughts and contributions at the above repo.

from webpage-micropub-to-github.

@paulrobertlloyd I've been lurking watching your repo so can't claim serendipity :-)

I'm excited too and am a willing guinea pig for my new site. Certainly will try to chip in where I can code wise or other types of contribution.

from webpage-micropub-to-github.