Author Archives: blacknred0

Docker container + X11 on macOS = Awesome

I’ve been exploring dockerizaton lately more and more and I think I like the idea of having my apps in containers.  I am not going to lie, it does take some time to get used to, but it is pretty cool the things that you can do.

One thing that I think I wanted to accomplish was able to run X11 apps through docker.  I found Docker Headless VNC container and that was slick.  Where I was able to run a whole Xfce environment within a Docker container!!! kudos to those folks.  Now, my challenge was that in my case, I didn’t want a fat image and/or configure each app to download of configuring. So, this wasn’t my solution at this time.  So, I decided to explore further and found a way to run X11 from a Docker container in macOS.  Below are the steps on how to accomplish this.

  1. Install XQuartz (X11),  Docker and homebrew.  You can follow their respective installation process.
  2. Install socat which is a “multipurpose relay.”  This will allow us to call the display.
  3. Create you local Dockerfile.  In this particular case, I am using Ubuntu latest (which at the time of this post is 16.04.1 LTS).  On your terminal, you can do “vi Dockerfile” and paste the info from below in that file.
  4. Then, let’s build the Docker image by doing the following…
  5. Now, on a different terminal, run the following command…
  6. Then come back to your old terminal (or a different one) and run this command
  7. At this point, you should have opened a Firefox instance from your Docker container through X11 on macOS 🙂
    If you didn’t… take a look at the steps again.  Happy dev and opening other X11 instances.

Sources:

http://fabiorehm.com/blog/2014/09/11/running-gui-apps-with-docker/

https://stackoverflow.com/questions/16296753/can-you-run-gui-apps-in-a-docker-container#

https://github.com/mbessler/docker-gnucash

https://hub.docker.com/r/palshife/ssh/

https://hub.docker.com/r/palshife/gnucash/

https://github.com/ConSol/docker-headless-vnc-container

https://askubuntu.com/questions/192050/how-to-run-sudo-command-with-no-password

https://stackoverflow.com/questions/27701930/add-user-to-docker-container

https://askubuntu.com/questions/842572/file-in-etc-sudoers-d-not-recognized

Python Mediacom Data Usage Prediction (mdup) via SMS

After years of monitoring my data usage and going over, I decided to make a dashboard (yes, like your car dashboard) for my ISP data usage.

I decided to publish this piece of code with the hopes that would help other people setting something up, where they could be notified via text message/SMS on their current data usage and predict what their usage will be by the end of the [billing] cycle.

Here is the repo -> https://github.com/blacknred0/mdup and the name of the project is “Mediacom Data Usage Prediction (mdup) via SMS”.

Python – Install pip and virtualenv and distribute without sudo access

Recently I started to so some dev on python and noticed that on the server that I was going to do the work I don’t have sudo access.  In the past, this has not been an issue, but in this case getting sudo access is almost impossible and not doable.  So my only option is being able to run pip (to install python packages) as an user.

After painfully researching on how to successfully do this, I was able to make it work.  I hope that this helps others in the future. Good luck!

  1. Make sure that you have python installed
  2. Download latest version of virtual environment (virtualenv)
  3. Unpack source tarball
  4. Create your package environment
  5. Delete the virtual environment folder
  6. Install virtualenv into your environment.  You can use the package that you downloaded or using pip.

    or
  7. If you want to clone environments you can do the following

Sources:
http://stackoverflow.com/questions/4324558/whats-the-proper-way-to-install-pip-virtualenv-and-distribute-for-python
https://pypi.python.org/pypi/virtualenv
https://packaging.python.org/installing/

Big Data, Data Science – Combo Course Training Classes Online | Big Data, Data Science – Combo Course Courses Online

Enroll for Big Data, Data Science – Combo Course Certification training classes online.Be a Big Data, Data Science – Combo Course Expert! ✓237 Hrs Learning ✓404 Hrs Projects ✓Life Time Access ✓24 X 7 Support ✓Job Assistance.

Source: Big Data, Data Science – Combo Course Training Classes Online | Big Data, Data Science – Combo Course Courses Online

Installing Multiple Version of R on the same machine for macOS (Mac)

 

Recently I wanted to install an application on a Mac, but it required an old version of R (3.2).  On Linux and Windows, that is easy, since you install the application on its own path.  Now, on a Mac, you can do it as well, but it will require extra work if you build it from source.  There is something better!!!  Here I outline what you can do easily…

Note that this illustration assumes that you want R 3.2 & 3.3 on the same system and be able to run either of them when you choose.

  1. Let’s assume that you already installed R 3.3 by downloading it from CRAN.
  2. To install R 3.2, you will need to download an old version from CRAN old R
  3. Before installing R 3.2, run the following commands
    sudo pkgutil --forget org.r-project.R.mavericks.fw.pkg
    sudo pkgutil --forget org.r-project.R.mavericks.GUI.pkg
    sudo pkgutil --forget org.r-project.R.mavericks.GUI64.pkg
  4. Install R 3.2 by double clicking on *.pkg
  5. Now, download and install RSwitch (RSwitch link), which it will allow you to switch between R version by clicking on the R version of your like.
    image

Sources:

Installing Multiple Version of R in parallel on the same machine – Mac OS X | R-bloggers

https://stat.ethz.ch/pipermail/r-sig-mac/2011-August/008534.html

https://cran.r-project.org/bin/macosx/RMacOSX-FAQ.html#How-can-R-for-Mac-OS-X-be-obtained-and-installed_003f

 

Ranking algorithm for the layman – New Modeler Extension

There are a lot of ranking algorithms for you to use and represent your data. Now, that doesn’t mean that the ranking algorithm is the most appropriate for your situation. It all depends on what you are trying to accomplish and who will be the audience of your final product. Some ranking algorithms could be too sophisticated to be actually understood by a layman’s type of person. The reasoning to develop this particular piece of work was to not only rank specific type of datasets but be able to explain how the ranking is performed for the layman’s type of person.

main-view

The inspiration for creating this node came from this site -> http://www.psychstat.missouristate.edu/introbook/sbk14.htm. Now that this node exists, it allows us to reuse it over and over. According to the author of the site, transforming raw scores into percentile ranking, will enable us to: 1) Give us meaning and interpret the scores and 2) Provide a direct comparison between scores.

Sample Output:
results-after-ranking

If you want to learn more and try this extension go to the GitHub Repository. You can find my extension and all others in thePredictive Analytics Gallery.

Source: Missouri State – Score Transfromations

Source: | Ranking algorithm for the layman – New Modeler Extension

Installing rJava in RHEL

Installing rJava on Ubuntu is a piece of cake. All you have to do the code below, and boom!!! You got rJava working in R.

Now, the challenge was trying to get rJava working on RHEL. I could not find any proper documentation that worked. Instead, I ran into a bunch of posts and pointing to things that worked in their environment, but not on mine (so, this might not work on yours as well, but I hope it does). I usually like to give credit to the sources, but this time, they were so many over a long time span, that I could not remember what came from where anymore. So, I apologize for that. Below are the things that I did to get rJava working.

packages need

Once, you have installed the necessary packages; then it is time to

configure your environment

And that is it! If you got the install.packages(“rJava”) to work on R, that means that now you can call Java from within R console.

Installing Moodle 3.0 on 1&1 shared host

I finally was able to find a guide that was able to allow me to setup Moodle on 1&1 Shared hosting environment.  To me, the only thing that I followed was deactivating “slash arguments” from “http://yourserver/admin/settings.php?section=http” section.  Once I did that, then my web HTML 1.0 site, got converted into a web HTML 3.0 (at least).

Thanks for the share!

Source: Installing moodle 2.6 on 1&1 Host » Gistlabs.net

Sophos UTM 9 blocking continuity between iPhone, iPad, Mac

I just recently migrated from Untangle 11.2 to Sophos UTM to give it a ride and noticed that a lot of things are blocked (which is a good thing if you know what you are doing and need to unblock it).  Just recently I noticed that I couldn’t make any more calls by using my iPad or Mac through my iPhone.  So, continuity was not working like it was before.

I went to the Apple site (see sources), but couldn’t figure out what port or services were the one that needed to be allowed by the firewall.  So, after analyzing dropped packages by the firewall, I noticed a pattern and created the following firewall rule.  Since the creation of this firewall rule, I haven’t had any more issues with continuity nor downloading content from games in Game Center.

Overall network mapping: Internal network -> Allow ports 6384:16472 -> Any

  1. Go to “Network Protection”
  2. “Firewall”
  3. Click “New rule…”
  4. Under “Sources:” add “Internal (Network)”
  5. Under “Services” (you probably haven’t created this, so we are going to do it the long way), click on the “+” to add a new service
  6. Give it a name.  Probably “Apple Continuity”
  7. On “Destination port:” allow ports from “16384:16472”
  8.  Under “Comment” add these ports are “Real-Time Transport Protocol (RTP), Real-Time Control Protocol (RTCP)” for “iChat AV (Audio RTP, RTCP; Video RTP, RTCP), FaceTime, and Game Center”
  9. Click “Save”
  10. Under “Destinations:” add “Any”
  11. (Optional) Add comment
  12. Click “Save”

Now you should be able to use Apple continuity by handing over calls over your iPad and/or Mac from your phone under the same network.

Hopefully Sophos UTM could include this as default with their future releases.

Source: TCP and UDP ports used by Apple software products – Apple Support