View Issue Details

IDProjectCategoryView StatusLast Update
2020Composr non-bundled addonsGeneral / Uncategorisedpublic2022-08-15 15:46
ReporterChris Graham Assigned ToChris Graham  
PrioritynormalSeverityfeature 
Status resolvedResolutionfixed 
Summary2020: Big syndication expansion and unification (idea staging issue)
DescriptionReplace the current video_syndication system.

Instead we'll have a big new system for syndicating any kind of content.

Services are covered on this spreadsheet: https://docs.google.com/spreadsheets/d/1_yaJeGzDIsxq33I7Wg9I-lTBDk3YS22WPBwJ971v5tI

Push:
 Dailymotion
 Facebook (videos)
 Minds
 Patreon
 Vimeo
 Facebook (posts) 1730
 And remove/rewrite what is currently under these addons:
  image_syndication
  gallery_syndication

Pull:
 Apple iPhone reviews
 Android reviews
 Dailymotion
 Facebook (posts) 1730
 Google+
 Instagram
 Minds
 Pinterest
 SoundCloud
 Vimeo
 Notes:
  Perhaps this can largely be done using RSS, or at least sharing code with "Listing block"

Push and pull may be used in conjunction, which effectively works as a free CDN and transcoding service.

~~~~

Relations to other systems...

upload_syndication (which currently conceptually overlaps with what is discussed here) will be replaced with 3147. Upload syndication is more to do with making content available across multiple sites, rather than just storing files. We'll no longer support upload syndication on a user-level, only a site-level, hence drawing a much stronger line between the two systems.

For anything we push and/or pull, syndicating comments (2-way) would be a great feature. See 1730.

We want activity syndication to be able to go to both a central channel, and the channel of the user doing the activity. This would not be implemented via the main system being discussed here (activities are separate to syndication), but needs to be considered when doing the overhaul. Activities will only go out to a small subset of the services we can push to.
TagsocProducts client-work (likely), Type: External dependency, Type: External social media integration
Attach Tags
Time estimation (hours)
Sponsorship open

Sponsor

Date Added Member Amount Sponsored

Relationships

related to 1730 ClosedChris Graham Composr non-bundled addons Facebook-sync forums with a Facebook page (for example - other services too) 
related to 3553 ResolvedChris Graham Composr Update simple social sharing (main_screen_actions) 
related to 1965 ResolvedChris Graham Composr More default messaging apps and social networks in CPFs 
related to 2980 ResolvedChris Graham Composr documentation Social media integration review and documentation 
related to 679 ClosedChris Graham Composr non-bundled addons Support syndicating scheduled activity 

Activities

Chris Graham

2016-02-02 03:12

administrator   ~3299

Last edited: 2018-03-06 06:08

Quick note that uploading and extracting from ZIP files doesn't currently trigger any syndication. It should do ideally.

Similarly, any scheduled actions (calendar and news) don't trigger any syndication. This issue is documented in tut_facebook, so people will know to workaround it - so that note needs removing.

The above affects:
 - Syndication (the main issue here)
 - Upload syndication (or whatever the new cloud filesystem implementation is called)
 - Activities

Chris Graham

2017-07-27 20:25

administrator   ~5174

Last edited: 2017-07-27 23:59

I had a look at some of the Open Source social networks. A couple stand out, but are still very obscure. There may be some interest here given the audience is much more technical so may have more affinity with OSS.

Diaspora 1/500th of Twitter
minds.com 1/150th of Twitter

Chris Graham

2018-03-04 23:07

administrator   ~5545

Last edited: 2018-03-06 05:49

This note in the documentation will need updating once we can syndicate out to Vimeo:
"install the [tt]gallery_syndication[/tt] addon, to automatically use YouTube as a transcoder."
This is because we're trying not to preference Google too much on the platform, listing alternatives where available.

Chris Graham

2019-06-08 16:17

administrator   ~5960

Look at Apple's new sign on button:
https://thenextweb.com/apple/2019/06/03/apple-introduces-privacy-focused-sign-in-with-apple-button-for-sites-and-apps/

Chris Graham

2019-12-12 14:24

administrator   ~6225

I am wondering if it might be better to rip out some of the syndication stuff from Composr, and instead have third-party systems do syndicating by looking at RSS (along with possibly something like RSS-Cloud or whatever).

Why have Composr integration with X services, and maintain all that, when it can just integrate with a single syndication standard?

Chris Graham

2020-10-22 17:28

administrator   ~6771

The Hybridauth library (which in v11 we've integrated for login) provides some of the functionality we need. I wonder if we can improve Hybridauth rather than adding a lot of stuff directly to Composr.

https://hybridauth.github.io/developer-ref-user-activity.html
https://hybridauth.github.io/developer-ref-user-status.html

Chris Graham

2020-11-10 03:11

administrator   ~6799

I've made big headway towards this issue, using Hybridauth (as indicated in my last comment).

Hybridauth is getting a new API, "Atom API" - which allows atom-feed like data to be pulled and pushed from Hybridauth providers that implement it.
I have it implemented for Facebook, Twitter, and Instagram (Instagram is read-only though due to FB restrictions on non-business accounts).
[Assuming they accept my pull request, which I am confident they will]

Composr's Hybridauth addon then integrates with the Atom API.

And Composr's activities API has been improved and renamed to syndication. The syndication API allows syndication of both content and of activities by any addons that choose to implement it.

Hybridauth, and the activity_feed addon, both implement the syndication API.

The activity_feed addon now uses Hybridauth for syndication activity content, rather than having its own Twitter and Facebook implementations. Meaning it can syndicate to anywhere Hybridauth can.
To clarify, the flow for this is:
Composr -> Syndication API -> activity_feed -> Hybridauth Atom API -> Hybridauth -> Social media networks..

I also intend to fold the old gallery_syndication API so that we truly just have one Composr syndication API, rather than a mess of different implementations that we had before.

Various issues we've had with the old activity_feed implementation are improved. For example, scheduled content can now be syndicated, as well as gallery content imported from Zip files.

The nice thing about building around Hybridauth is that we avoid having to take responsibility for adding all kinds of third party integrations directly into Composr. The Hybridauth project can do that, and we can contribute to that project ALONGSIDE OTHERS WHO ALREADY DO. We're expanding the scope of Hybridauth beyond mostly a system for login buttons into a major PHP social network integration library that hasn't existed yet.

To that end, I don't have any plans to implement into Hybridauth the long tail of different social networks identified in this issue and our tracking spreadsheet. Instead I will bring these suggestions to the Hybridauth project, and if people want to contribute/sponsor that via Hybridauth, great. It doesn't all need to be directly under our own umbrella. And this absolves us from the need to be a gatekeeper on what social networks are valid/reputable.

I have removed/deconsidered any functionality revolving around users syndicating content to their personal feeds. This isn't a recommended thing nowadays, which is good (it's spammy and bloated).
I have dropped the idea of trying to cross-post forum posts and comments across mediums as it wouldn't work well and would be messy.

I plan for us later to also build a new PHP filesystem wrapper around the Hybridauth Atom API too - for integration with things like Dropbox, Amazon S3, and so on. This is issue 3147. However, at this point I want to completely separate any discussion of that and put it in its own corner, for version 12, which should include many Cloud improvements to Composr.

All-in-all, things are now streamlined and pointing in the right way, a lot of progress is made.

Issue History

Date Modified Username Field Change
2016-12-08 00:48 Chris Graham Summary Big syndication expansion and unification => Big syndication expansion and unification (holding issue)
2016-12-08 16:01 Chris Graham Description Updated
2016-12-08 16:06 Chris Graham Relationship added related to 2979
2016-12-08 16:08 Chris Graham Relationship deleted related to 2979
2016-12-08 16:08 Chris Graham Relationship deleted parent of 1392
2016-12-08 16:08 Chris Graham Relationship deleted parent of 1450
2016-12-08 16:08 Chris Graham Relationship deleted parent of 1264
2016-12-08 16:08 Chris Graham Relationship deleted parent of 831
2016-12-08 16:08 Chris Graham Relationship deleted parent of 974
2016-12-08 16:08 Chris Graham Relationship deleted parent of 975
2016-12-08 16:08 Chris Graham Relationship deleted parent of 679
2016-12-08 16:08 Chris Graham Relationship deleted related to 1730
2016-12-08 16:09 Chris Graham Relationship deleted related to 1965
2016-12-08 16:09 Chris Graham Tag Attached: Type: External social media integration
2016-12-08 16:29 Chris Graham Relationship added related to 1965
2017-03-21 21:59 Chris Graham Relationship added related to 3147
2017-07-09 13:41 Chris Graham Tag Attached: ocProducts client-work (likely)
2017-07-27 20:25 Chris Graham Note Added: 0005174
2017-07-27 23:59 Chris Graham Note Edited: 0005174
2017-11-20 15:07 Chris Graham Description Updated
2017-11-30 14:16 Chris Graham Description Updated
2018-03-04 22:45 Chris Graham Description Updated
2018-03-04 22:48 Chris Graham Description Updated
2018-03-04 23:01 Chris Graham Description Updated
2018-03-04 23:07 Chris Graham Note Added: 0005545
2018-03-06 04:45 Chris Graham Relationship added related to 2980
2018-03-06 05:32 Chris Graham Relationship added related to 1264
2018-03-06 05:40 Chris Graham Note Edited: 0003299
2018-03-06 05:48 Chris Graham Relationship added related to 679
2018-03-06 05:49 Chris Graham Note Edited: 0005545
2018-03-06 06:02 Chris Graham Description Updated
2018-03-06 06:02 Chris Graham Additional Information Updated
2018-03-06 06:05 Chris Graham Description Updated
2018-03-06 06:05 Chris Graham Additional Information Updated
2018-03-06 06:06 Chris Graham Relationship added related to 1730
2018-03-06 06:06 Chris Graham Note Edited: 0003299
2018-03-06 06:08 Chris Graham Note Edited: 0003299
2018-03-06 06:12 Chris Graham Relationship added related to 3553
2019-06-08 16:17 Chris Graham Note Added: 0005960
2019-06-27 19:07 Chris Graham Tag Attached: Roadmap: v12
2019-06-27 19:07 Chris Graham Tag Attached: Type: External dependency
2019-06-27 19:27 Chris Graham Summary Big syndication expansion and unification (holding issue) => Big syndication expansion and unification (idea staging issue)
2019-12-12 14:24 Chris Graham Note Added: 0006225
2020-10-22 17:28 Chris Graham Note Added: 0006771
2020-11-10 02:36 Chris Graham Relationship deleted related to 3147
2020-11-10 02:36 Chris Graham Relationship deleted related to 1264
2020-11-10 03:11 Chris Graham Note Added: 0006799
2020-11-13 22:37 Chris Graham Assigned To => Chris Graham
2020-11-13 22:37 Chris Graham Status Not Assigned => Resolved
2020-11-13 22:37 Chris Graham Resolution open => fixed
2022-08-15 15:46 Chris Graham Tag Detached: Roadmap: v12
2023-02-26 18:29 Chris Graham Category General => General / Uncategorised