Image-sequencer: IS Nightly

[harshkhandeparkar]

@jywarren @publiclab/is-reviewers how about creating an IS nightly website where daily builds are pushed? The page can be updated everyday after all the PRs of that day are merged. It will be different from the sequencer.publiclab.org website since only stable versions are pushed there. This will help users find bugs in the latest code easily and be like beta testers without having to clone the repo and do all the things the developers do. This can be like an end user feedback form. What are your thoughts??

---

Thank you!

Your help makes Public Lab better! We deeply appreciate your helping refine and improve this site.

To learn how to write really great issues, which increases the chances they'll be resolved, see:

https://publiclab.org/wiki/developers#Contributing+for+non-coders

[jywarren]

Hi, I think this is a cool idea; we might start with weekly to make it a
bit easier? Would we run it from another account's github pages? And could
there be some automation to help this go smoother? For example, who would
do the updating? Would they have to run a script each day?

Thanks for this cool idea!

On Fri, Mar 15, 2019 at 3:09 AM Harsh Khandeparkar [e-mail]
wrote:

@jywarren https://github.com/jywarren @publiclab/is-reviewers
https://github.com/orgs/publiclab/teams/is-reviewers how about creating
an IS nightly website where daily builds are pushed? The page can be
updated everyday after all the PRs of that day are merged. It will be
different from the sequencer.publiclab.org website since only stable
versions are pushed there. This will help users find bugs in the latest
code easily and be like beta testers without having to clone the repo and
do all the things the developers do. This can be like an end user feedback

form. What are your thoughts??

Thank you!

Your help makes Public Lab better! We deeply appreciate your helping
refine and improve this site.

To learn how to write really great issues, which increases the chances
they'll be resolved, see:

https://publiclab.org/wiki/developers#Contributing+for+non-coders

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/publiclab/image-sequencer/issues/857, or mute the
thread
https://github.com/notifications/unsubscribe-auth/AABfJ_XvynSQSUqH8jxwWdCJF8DV5QR1ks5vW0bmgaJpZM4b11xV
.

[harshkhandeparkar]

How about runing it on jywarren/image-sequencer? Can you update it yourself?

[jywarren]

I don't think i could keep up -- i'm already struggling a bit to stay
current. This is one reason I thought of an automated solution. Or if
someone wants to volunteer?

On Fri, Mar 15, 2019 at 2:22 PM Harsh Khandeparkar [e-mail]
wrote:

How about runing it on jywarren/image-sequencer? Can you update it
yourself?

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/publiclab/image-sequencer/issues/857#issuecomment-473393878,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AABfJ_FsYzDweiz9YuDgSvTuhSkcW9U1ks5vW-TUgaJpZM4b11xV
.

[harshkhandeparkar]

It can be hosted on maybe sequencer.beta.publiclab.org and since prs are not merged everyday, it can be updated when they are. What do you say? Can you do that? Just merging gh-pages with publicab/main every night(when prs are merged)??

[harshkhandeparkar]

Is there a bot which can help?

[harshkhandeparkar]

I would have been more than happy to volunteer but I will be busy for 2 yrs as I have mentioned many times bfore.

[harshkhandeparkar]

There is a way to automate this....

Does PL have a server which runs 24hrs?

[harshkhandeparkar]

@subhahu123 do you have any good ideas for this?

[harshkhandeparkar]

@Harshithpabbati

[harshithpabbati]

Yeah !!

[harshkhandeparkar]

Do you know some way to do this auto updating? A bit maybe?

[harshithpabbati]

I will check through this.

[harshithpabbati]

Or else I can volunteer for this to update them.

[harshkhandeparkar]

Oh Awesome. You can ask @jywarren about that. Thank you.

[harshkhandeparkar]

Do you use linux btw? @Harshithpabbati

[harshithpabbati]

Yeah.

[harshkhandeparkar]

I can write a script for you if you want. You can type update-is in the terminal and it will do everything for you and finally ask for your github username. Shall I do that. It won't be very difficult.

[harshithpabbati]

Ok thanks for that!!

[harshkhandeparkar]

Cool. Should it be update-is or something else?

[harshithpabbati]

Make it update-is no prob.

[harshkhandeparkar]

Ok. The script is really easy actually.

Edit: posted below

This will ask for your username and password.

You can create a directory named bin in your home folder /home/[username]/

create a file named update-is without any extension in the bin folder. Drop the code mentioned above and run this command

username@pc:~$ sudo chmod +x ~/bin/update-is

That is it.

You can try this out right now. You will have to initialize gh-pages though. Please note that this will directly copy the code here and it will not work if you have the /image-sequencer/ in the URL as the manifest.json will not allow you to do that. So you will have to host this on some actual URL like beta.sequencer.publiclab.org. I don't know how you can do that but you can ask @jywarren for the hosting. To redirect to that URL you can change the file CNAME and the script already does that. Thank you.

[harshithpabbati]

Thanks @harshkhandeparkar

[harshkhandeparkar]

I have edited the comment. Please read it again

[harshithpabbati]

@HarshKhandeparkar hey did you renamed it as is ???

[harshkhandeparkar]

Renamed what?

[harshithpabbati]

Getting an error when i tried to run it.

[harshkhandeparkar]

Can you please tell me the error?

[harshithpabbati]

see this.

[harshkhandeparkar]

Sorry for that. I have updated the comment again.

[harshkhandeparkar]

Btw you dont have to cd image-sequencer

[harshkhandeparkar]

Another update. Just enhanced the script.

[harshkhandeparkar]

Reposting full script
Edit: reposted below.

[harshithpabbati]

Done !! Thanks :+1:

[harshkhandeparkar]

Cool!

[harshithpabbati]

but i can't get the node modules .

[harshkhandeparkar]

I can't see a gh-pages branch in your fork.

[harshkhandeparkar]

Please initialize github pages for your fork in the repo settings.

[harshithpabbati]

It's not working.

[harshkhandeparkar]

Error?

[harshithpabbati]

no. I made it but the changes were not done. I am doing it manually now.

[harshkhandeparkar]

Have you initialised GitHub pages?

[harshkhandeparkar]

You will see something like this in the settings of your fork

edit: img not reqd

[harshithpabbati]

yeah.

[harshithpabbati]

It's done !!!. See this https://harshithpabbati.github.io/image-sequencer/examples/#steps=

[harshkhandeparkar]

Totally awesome!!

[harshkhandeparkar]

@jywarren Harshithpabbati has agreed to volunteer. We have managed to automate the process. We have even changed the CNAME to beta.sequencer.publiclab.org can we host his gh-pages on beta.sequencer.publiclab.org?

[harshkhandeparkar]

@Harshithpabbati can you document this somewhere?

[harshithpabbati]

@harshkhandeparkar what should I do?? I mean documentation.

[harshithpabbati]

Should I write the process what we want to do??

[harshkhandeparkar]

We can just add a line linking to this website once it is hosted on beta.sequencer.publiclab.org.

You can update this whenever you get time. Try to do this daily after all the prs are merged. Since the timezones do not match, you can update at any time of the day. No need to update if no prs have been merged.

Thanks a ton!!

[harshithpabbati]

Ha ok. I have a how to link it to beta.sequencer.publiclab.org???

[harshkhandeparkar]

You can add a line to the CONTRIBUTING.md file or add a link in the webpage footer or both. But lets wait for @jywarren's thoughts on this and lets wait to get this hosted on beta.sequencer.publiclab.org. The full link will have https:// i.e. https://beta.sequencer.publiclab.org

[harshkhandeparkar]

@Harshithpabbati wherever your main clone of image-sequencer is on your pc, it will not be touched. You can run this command from any directory and your main clone will not get affected and nothing will change on your system. You can run the command as many times as you want.

[harshithpabbati]

Yeah I know it.

[harshkhandeparkar]

When we get permission to host on beta.sequencer.publiclab.org, opening harshithpabbati.github.io/image-sequencer will redirect to that. You probably don't have to do anything. @jywarren will give you further instructions and provide permissions to the domain. You just have to update your gh-pages. Maybe the main stable website sequencer.publiclab.org can be updated every month? Any thoughts on this? Improvements? Other ideas? Finishing touches?

[harshithpabbati]

Yeah it's fine :)

[harshithpabbati]

@harshkhandeparkar I runned it but it is not working .

[harshithpabbati]

I mean there is no change in gh-pages

[harshithpabbati]

see this I was not asked with github username and password.

[harshkhandeparkar]

Ok I guess the remote has to be adder manually. Wait a min. I will change that.

[harshkhandeparkar]

Reposted . @Harshithpabbati try making these changes.

Edit: reposted below

[harshithpabbati]

see this @HarshKhandeparkar

[harshkhandeparkar]

A small change, now it will not ask for anything.

Edit: reposted below

[harshithpabbati]

Everytime when i run this. It is cloning again.

[harshkhandeparkar]

It has to clone again to make sure that no old changes conflict with the latest version. Myabe the branch was changed somehwere else, but the local was not changed. So it clones everytime.

[harshithpabbati]

See the css @HarshKhandeparkar

[harshkhandeparkar]

I think @aashna27 is fixing this issue.

[harshkhandeparkar]

Great! Edge detect PR changes have been added.

[harshkhandeparkar]

Another small change. Sorry @Harshithpabbati
Edit: reposted below

[harshithpabbati]

@jywarren what do you say ???

[jywarren]

Oh my goodness so much happened in this thread. 😅

This looks great. I'll repoint beta.x and perhaps we can do a few things
next:

1. if the script is confirmed to be working, could we make it into a Grunt
   or npm task?
2. maybe icarito can set this up for us in Jenkins as a regular task once
   we test it out a bit

Thanks!

On Mon, Mar 18, 2019 at 4:26 AM Harshith pabbati [e-mail]
wrote:

@jywarren https://github.com/jywarren what do you say ???

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/publiclab/image-sequencer/issues/857#issuecomment-473813746,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AABfJ-tcjRxPf0XGYkF-DU7wUNTKyEtHks5vX02igaJpZM4b11xV
.

[harshkhandeparkar]

This is not a js script but instead it is a bash script which runs on the pc and also it is specific for harshith's account. It clones his repo and checks out gh-pages and merges with main, builds dist, force commits node_modules and pushes to his gh-pages by asking for a password.

So what it does is it clones the repo in a hidden folder on his pc's home folder (in linux) and does all of the processing/updating there.

[jywarren]

For sure, but npm scripts don't need to be JS - they can run shell scripts
too. Would it be possible to adapt it to take inputs or otherwise detect
your github username/branch etc? Thanks! Just trying to think how we'd
adapt this for a bot to use, for example.

On Mon, Mar 18, 2019 at 12:33 PM Harsh Khandeparkar <
[email protected]> wrote:

This is not a js script but instead it is a bash script which runs on the
pc and also it is specific for harshith's account. It clones his repo
and checks out gh-pages and merges with main, builds dist, force commits
node_modules and pushes to his gh-pages by asking for a password.

So what it does is it clones the repo in a hidden folder on his pc's
home folder (in linux) and does all of the processing/updating there.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/publiclab/image-sequencer/issues/857#issuecomment-473992840,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AABfJyz5qS5TxZ3IFLSRQP6_O4ZVJ5Kpks5vX7-ngaJpZM4b11xV
.

[harshkhandeparkar]

Can a bot have repos?

[harshithpabbati]

Yeah we can take input and can make it run.

[harshithpabbati]

Oh yah the bot can't have the repo 😅

[harshithpabbati]

I will repost this such that everyone can use this .

[harshkhandeparkar]

@jywarren does PL have a server which runs 24x7??

[jywarren]

Yes we do!

On Mon, Mar 18, 2019 at 1:34 PM Harsh Khandeparkar [e-mail]
wrote:

@jywarren https://github.com/jywarren does PL have a server which runs
24x7??

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/publiclab/image-sequencer/issues/857#issuecomment-474022297,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AABfJyFkiu6XsQLQ_gcJIeL5myDFqVc1ks5vX84KgaJpZM4b11xV
.

[jywarren]

I also use my own publish to gh-pages script, fwiw:

git checkout main
git pull publiclab main
git checkout gh-pages
git merge main -m 'merge from main'
npm install
git add -f node_modules package-lock.json # inefficient because we don't really need ALL node modules...
git commit -m 'added node modules for gh-pages demo'
git push publiclab gh-pages
git checkout main
npm install

[jywarren]

Also, i just released the latest to https://sequencer.publiclab.org and pointed beta.sequencer.publiclab.org to https://harshithpabbati.github.io/image-sequencer/!

[harshithpabbati]

@jywarren check the url beta.sequencer.publiclab.org i cant get it.

[jywarren]

ah, you need to add a CNAME file!

[harshithpabbati]

Where should i add it ??? in gh-pages branch ??

[jywarren]

That's right!

On Mon, Mar 18, 2019, 9:23 PM Harshith pabbati [e-mail]
wrote:

Where should i add it in gh-pages branch ??

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/publiclab/image-sequencer/issues/857#issuecomment-474161448,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AABfJ4u1vnStA044RBNpHudxDToekg8Uks5vYDvfgaJpZM4b11xV
.

[harshkhandeparkar]

Hello harshith, the last revision of the script I made actually creates the CNAME file and also points to beta.sequencer.publiclab.org. Please change your script locally.
Reposting

#!/bin/bash
set -e

if [ -d ~/.is ];
then
  pushd ~/.is

  if [ -d ~/.is/image-sequencer/ ];
  then
    rm -rf ~/.is/*
  fi
    git clone https://github.com/Harshithpabbati/image-sequencer.git

    pushd ~/.is/image-sequencer/
    git checkout gh-pages
    git remote add upstream https://github.com/publiclab/image-sequencer.git
    git fetch upstream
    git merge -f upstream/main
    npm run setup
    grunt browserify
    grunt uglify

    if [ ! -f CNAME ];
    then
      touch CNAME
    fi
    echo "beta.sequencer.publiclab.org" > CNAME

    git add .
    git add -f node_modules/
    git commit -m "update"
    git push

    popd 
    popd
else
  mkdir ~/.is
  update-is
fi

[harshkhandeparkar]

Hey harshith, would you mind posting the update script somewhere on github so I can propose cahnges whenever needed? When we add the dist files to gitignore, the script will have to be changed, if anything breaks, I can open a pr and then you can pull the latest script when ot gets updated. Would you mind putting it on github?

[harshithpabbati]

Ok where should I keep it ?? In my repos??

[harshkhandeparkar]

Anywhere you like. Just tell me where. Thanks.😊

[harshithpabbati]

Fine i will create a repo and I will send you the link.

[harshkhandeparkar]

@Harshithlabbati a new pr was juet merged! Please run the script. Also please make sure that you have the latest version that I had posted. It adds the CNAME file to the branch. Let's see if beta.sequencer.publiclab.org redirects.

[harshithpabbati]

Yeah it's redirecting :+1:

[harshkhandeparkar]

I will close this issue in a pr where this is documented in README.md file. @jywarren I noticed that the description of this repo has the link http://sequencer.publiclab.org can it be changed to have https?

[jywarren]

Yes that'd be great but I also set it up to force https now.

On Tue, Mar 19, 2019, 8:38 AM Harsh Khandeparkar [e-mail]
wrote:

I will close this issue in a pr where this is documented in README.md
file. @jywarren https://github.com/jywarren I noticed that the
description of this repo has the link http://sequencer.publiclab.org can
it be changed to have https?

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/publiclab/image-sequencer/issues/857#issuecomment-474344056,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AABfJ2KFzvDAaJfk6wN41fWaxQejLKtkks5vYNoLgaJpZM4b11xV
.

[harshithpabbati]

Do I need to document about beta.sequencer.publiclab.org

[harshithpabbati]

Ok I am done with the script.

[harshkhandeparkar]

I will do the documentation

[harshithpabbati]

Ok fine thanks.

[jywarren]

Hi @harshithpabbati @HarshKhandeparkar shall we place this script in a /scripts/ folder in the repository? Thanks!

[harshkhandeparkar]

The core script is in my repo HarshKhandeparkar/Update-is and the github action is in Harshith's repo. We can definitely migrate the script but that won't change Harshith's github action.

[harshithpabbati]

Yes @jywarren, we can do that.