A collection of random ideas so I don't have to google again
© 2018 - 2023 A collection of random ideas so I don't have to google again
Building Your Own Personal Assistant With ChatGPT
If you’ve ever used Siri, Alexa, or Google Assistant, you know how powerful and convenient having a personal assistant can be. What if you could build your own personal assistant, tailored to your specific needs? Thanks to the power of OpenAI’s ChatGPT language model and the open-source community, you can!
In this post, we’ll explore a GitHub project called “ChatGPT-chan,” which provides a collection of tools to help you build your own personal assistant.
3 minutes read
Hudson and Thames mlfinlab stuff
Dockerfile FROM python:3.8-slim-buster RUN apt update && apt install git -y RUN apt install -y build-essential g++ libgl1-mesa-glx libx11-6 cmake protobuf-compiler -y RUN python -m pip install jupyter cvxpy RUN git clone https://github.com/rushic24/mlfinlab.git && cd mlfinlab && python setup.py install RUN pip install pandas==1.5.2 tqdm statsmodels==0.13.5 numpy==1.23.5 EXPOSE 8890 ENTRYPOINT [ "jupyter", "notebook", "--no-browser", "--port=8890", "--ip=0.0.0.0", "--allow-root" ] Makefile # Specify the name of the image IMAGE_NAME = "mlfinlabstuf" # Specify the path to the Dockerfile DOCKERFILE_PATH = ".
1 minutes read
Apache Hadoop Stack: MapReduce, Pig, Spark, Hive
Apache Hadoop Stack: MapReduce, Pig, Spark, Hive 1. HDFS CLI: load input data list all directories hadoop fs -ls make a new directory to store movie data hadoop fs -mkdir movieData copy data file from local to hdfs hadoop fs -copyFromLocal u.data movieData/u.data 2. MapReduce with Python: movies sorted by rating counts script from mrjob.job import MRJob from mrjob.step import MRStep class RatingsBreakdown(MRJob): def steps(self): return [ MRStep(mapper=self.mapper_get_movie, combiner=self.combiner_count_ratings, reducer=self.reducer_count_ratings), MRStep(reducer=self.
6 minutes read
Collaborative Filtering on Amazon Products With PySpark
Goals Recommend top 5 products for an user: RMSE = 1.22 Data set description This is a list of over 34,000 consumer reviews for Amazon products like the Kindle, Fire TV Stick, and more provided by Datafiniti’s Product Database. The dataset includes basic product information, rating, review text, and more for each product. Note that this is a sample of a large dataset. The full dataset is available through Datafiniti. from pyspark.
4 minutes read
Golden Hour of Publishing Comments
Hacker News is a site similar to Reddit where user-submitted stories (known as “posts”) are voted on and commented on. In the tech and startup worlds, Hacker News is immensely popular, and pieces that reach the top of the site’s listings can get hundreds of thousands of views.
We’ll compare these two types of posts to determine the following: 1. Do ‘Ask HN’ or ‘Show HN’ posts receive more comments on average?
6 minutes read
Modeling and Analysis of One Finger QWERTY Keyboard Typing Using Fiit's and Zipf's Laws
Goals 1. Modeling the keyboard 2. Fiit’s law parameter estimation: r-squared = 0.709 3. Average typing time of 1000 most frequent words: 0.99 4. Zipf’s law parameter estimation & average typing time of 1000 most frequent words: 0.71 import matplotlib.pyplot as plt import math import numpy numpy.set_printoptions(precision=2) import scipy.stats as stats import statsmodels.api as sm from statsmodels.graphics.regressionplots import abline_plot import seaborn as sns 1. Keyboard modeling # Define keyboard line1 = 'qwertyuiop' line2 = 'asdfghjkl' line3 = 'zxcvbnm' # Define a keyboard as a list of keys.
10 minutes read
T490 Fan Speed Configuration With Thinkfan
I love Thinkpads. They are robust and durable. And no need to mention about their world class keyboards!
It works like a charm, but we need to configure it a bit for silence. Let’s start!
1. Install the necessary package sudo apt install thinkfan 2. Create the configuration file After installing the package we need to create a config file in the following directory: /etc/thinkfan.conf
This file requires three main items:
2 minutes read
Wayvnc Arch Linux (Pinephone)
Traditionally we have been using Xorg or X11 as the display server on linux. Wayland is a similar display server which aims to be a modern and more optimized. I’m not much used to wayland and this is a guide for using wayvnc, a vnc server for wayland. Any vnc client like tigervnc/ realvncviewer can be used.
# Install wayvnc sudo pacman -S wayvnc Create a config with the authentication info and load it using the –config command line option or place it at the default location $HOME/.
1 minutes read
Why Do We Need an Opensource Face Detection APIs?
A comparison of different Face Detection APIs in the industry Why do we need an opensource face detection APIs ? Consider we have around 80,000 videos which consists of around a total of 72 million frames. Below is an analysis of how different competitor’s face detection APIs would cost for 72 million frames. Some people have a myth that opensource models don’t work that well compared to these premium services. I’ve also shared a few test screenshots on how even premium service give false positives.
3 minutes read
Convert Browser Requests to Python
Scraping dynamic content these days is bit difficult as there are wide variety of authentication mechanisms and web server needs correct headers, session, cookies to authenticate the request. If we need to quickly scrape content just for once, implementing authenticationis an overhead. Instead, we can manually login to the website, capture an authenticated request and use it for scraping other pages by changing url/form parameters.
curl 'https://www.glassdoor.com/member/home/index.htm' -H 'User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:99.
2 minutes read
关于我
g1eny0ung 的 ❤️ 博客
记录一些 🌈 生活上，技术上的事
一名大四学生
马上（已经）毕业于 🏫 大连东软信息学院
职业是前端工程师
业余时间会做开源和 Apple App (OSX & iOS)
主要的技术栈是：
- JavaScript & TypeScript
- React.js
- Electron
- Rust
写着玩（写过）：
- Java & Clojure & CLJS
- OCaml & Reason & ReScript
- Dart & Swift
目前在 PingCAP 工作
– 2020 年 09 月 09 日更新
我的一些开源项目
- Petal 🌺 ➡️ 豆瓣 FM 桌面版
- hugo-theme-dream 🌱 ➡️ HUGO 的博客主题，当然，也是你现在看到的博客主题
- Alfred-Colors-workflow ➡️ Alfred 插件：CSS 颜色格式转换 hex <=> rgb <=> hsl
- github-colorful-contributions-graph ➡️ 改变 GitHub 贡献面板颜色的 Chrome 插件
- day.dart ➡️ ⏰ Day.js in dart.
其他
如果你喜欢我的开源项目或者它们可以给你带来帮助，可以赏一杯咖啡 ☕ 给我。~
If you like my open source projects or they can help you. You can buy me a coffee ☕.~
PayPal：
Patreon:
微信赞赏码：
最好附加一下信息或者留言，方便我可以将捐助记录 📝 下来，十分感谢 🙏。
It is better to attach some information or leave a message so that I can record the donation 📝, thank you very much 🙏.