Skip to content
This repository has been archived by the owner on May 15, 2019. It is now read-only.

Spot naming #73

Open
wants to merge 7 commits into
base: tmp_spot
Choose a base branch
from

Conversation

NathanSegerlind
Copy link
Contributor

No description provided.

duxbay and oni and open-network-insight and all such variations renamed to "spot"
Open Network Insight => Apache Spot (incubating) in the readme and install files.
Copy link

@rabarona rabarona left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please review my comments and let me know what you think.

@@ -1,3 +0,0 @@
[submodule "oni-lda-c"]
path = oni-lda-c
url = https://github.com/OpenNetworkInsight/oni-lda-c
Copy link

@rabarona rabarona Sep 28, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure why to remove for the oni to spot change. I think this change corresponds to changing repos structure o renaming repos. This is eliminating the recursivity of ml and lda, right?

My point is we never sync .gitmodules file. After repo restructure we can git pull and everything should be in order.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

dammit
this was not supposed to be removed

not sure why the file got blown away

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hell, in my current repo I can't even add this file to git, it's being ignored...
something is weird

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i added this back in

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I saw that, thanks.

Install and configure oni-ml as a part of the Open-Network-Insight project, per the instruction at
[the Open-Network-Insight wiki](https://github.com/Open-Network-Insight/open-network-insight/wiki).
Install and configure spot-ml as a part of the Spot project, per the instruction at
[the Spot wiki].

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So, for now you are just keeping links placeholders rather than let them point to the current repo structure?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah
will add new repo structure when it all comes on line

@@ -1,4 +1,4 @@
package org.opennetworkinsight
package org.spot
Copy link

@rabarona rabarona Sep 28, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this the case where we need to use apache in the package name? Or is that happening after incubating process?
org.apache.spot?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good question...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

apache beam does it (eg. org.apache.beam...)

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the incubating project "Apache Rya (incubating)" does not do it
so I guess there is flexibility

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thumbs up for which option?

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

org.apache.spot

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like that too
🐶

update of ml_ops.sh

finally added the util script upload.sh to git
replacing blown away .gitmodules file
org.spot => org.apache.spot

Oh Yeah....
Copy link

@rabarona rabarona left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks nicer.

@@ -84,7 +84,7 @@ hdfs dfs -rm -R -f ${HDFS_SCORED_CONNECTS}

${MPI_PREP_CMD}

time spark-submit --class "org.opennetworkinsight.SuspiciousConnects" \
time spark-submit --class "org.spot.SuspiciousConnects" \

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So we was missing this one?

Copy link

@rabarona rabarona left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure about upload.sh being in the repo.

# exclude the hidden files, target, lib, project, src... except the assembled jar
rsync $4 -v -a --include='target' --include='target/scala-2.10' --include='target/scala-2.10/*.jar' \
--include='spot-lda-c' --include='spot-lda-c/*' --include='*.py' --include='*.sh' --include 'top-1m.csv' \
--exclude='*' . $USER@$CLUSTER:~/$DIRNAME

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this file be part of the project?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

on one hand:

people would almost certainly use it and appreciate it

on the other:

there is a process for adding stuff to the product and we didn't follow it
there's no documentation for it

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so I'm taking it out

on second thought,  upload.sh won't be added to git at this time
@rabarona
Copy link

LGTM

@EverLoSa EverLoSa changed the base branch from dev to tmp_spot September 30, 2016 19:05
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants