如何写一个简易的爬虫基本概念有言在先本文只是新手文,望各位指正
本文图片之类链接打不开,可直接科学上网走外链,参考 原博文
啥是爬虫按一定规则,遵循协议实现的请求模拟接口。
学会爬虫的好处
了解一些法律常识
吃牢饭
学习 web 相关的基础知识
推荐阅读robots 协议
Requests 官网文档
大才哥的 Blog
Scrapy 官网文档
基础12with open('/usr/bin/ls', 'w') as f: f.write(parse(request.get("http://api.com?id=1' ...
如何写一个简易的chrome插件推荐阅读https://developer.chrome.com/extensions/getstarted
推荐阅读官方文档,本文只做简单的演示。
本文图片之类链接打不开,可直接科学上网走外链,参考 原博文
概念介绍基本配置
manifest.json
可以类比 AndroidManifest,几乎所有的项目都会有一个主配置文件,用来配置全局的基本信息和属性来保证系统的基本启动运行,该文件为 chrome plugin 主配置文件。基于浏览器插件考虑所占体积这个特性,几乎所有关键的配置属性信息都可以在此找到,除了名称,版本等必要的信息,尤为值得关注...
As Liquibase executes the databaseChangeLog, it reads the changeSets in order and, for each one, checks the “databasechangelog” table to see if the combination of id/author/filepath has been run. If it has been run, the changeSet will be skipped unless there is a true “runAlways” tag. After all ...
Since jdk 8 update, some tools has broken cause it’s new feature. For example, javasisit:
Ebean lazyloading get failure that data not load all but only one attribute like UUID from children model.
And for the reason, finally found this: https://github.com/jboss-javassist/javassist/pull/10
The...
基本概念仓库: 就是项目文件存放的位置,如果只完成第一步,不需要私有仓库,因为现在私有仓库免费了,所以考虑用私有仓库作为你的博客内容文件,用来存一些你觉着可能会用到但是又不希望别人看到的文件.仓库的名字可以随便取,但有一个名字是有特殊含义的,就是 UserName.github.io, 这个往往用来作为博客域名,并且你可以为其申请免费 https
CNAME: 当你不喜欢上面那个域名,就可以通过在根目录下添加该文件来作 CNAME 转发
自动化部署: 就是你觉着每次都不用改变的重复劳动, 写成脚本即可,比如博客部署流程
博客部署流程: 本地 source 目录决定内容, _config....
LLone github: https://github.com/ReZeroS/LLone A LL parser is a top-down parser for a subset of context-free languages. It parses the input from Left to right, performing Leftmost derivation of the sentence. What do we have to make as input arguments or basic default value?
We will input “#i+i*i...
Markdown edit
Typora
Atom
VS code
IDE
Idea
Pycharm
Android Studio
CodeBlocks, VS, Clion
Racket
Screen Shot
Snipaste
Screen2Gif
Browser
Firefox development
Chrome
Version control
git (without GUI)
Instant Messaging
Tim
Telegram
PDF reader
Jiusu PDF
Penetration test tool
V...
FTP service setup
Setup vsftpd sudo apt-get install vsftpd -y
Start vsftpd
check whether the port 21 is working sudo netstat -nltp | grep 21
if the above not start, you can do it manually sudo systemctl start vsftpd.service
Config the User directory
make a directory sudo mkdir /home/uftp
mak...
package com.loader;
import java.io.ByteArrayOutputStream;
import java.io.File;
import java.io.FileInputStream;
import java.io.InputStream;
/*
/Bootstrap Classloader -> rt.jar
Extension Classloader extends Classloader -> %JAVA_HOME%/lib/ext/*.jar
App Classloader extends Classloader -> ...
Source: https://www.ibm.com/developerworks/cn/java/analysis-and-summary-of-common-random-code-problems/index.html?cm_mmc=dwchina-_-homepage-_-social-_-weibo#N101F9
Reason
Encode
Decode
Lack of a font library
Analysis phenomenon
Caused by encoding
In English Windows, u create a txt, type and ...