Skip to navigation Skip to content
Simon Technology Blog
  • Architecture
  • Cloud
  • Database
  • Develop
  • Hardware
  • Industry
  • Language
  • Mobile
  • Opensource
  • OS
  • Web
Main Navigation

Author: Simo

Climber —- foundation

Request module:

More documents: http://cn.python-requests.org/zh_CN/latest/ p> Install

pip install requests
Use

import requests

response=requests.get(“https://movie.douban.com/

September 28, 2021By Simo Web Crawler foundation, reptileLeave a Comment

Amazon-Web-Services – Automatic Extension Group Host Name and Cloud-Init

From a short search-it seems that there is no way to set dynamic hostnames for members of the auto-scaling group. OpenStack Heat uses the indexing function-but I can’t find anything related to the

September 28, 2021By Simo Silicon Valley Amazon, Auto, Cloud, Extensions, Group, Host Name, Init, Services, WEBLeave a Comment

Climber —- Teamwork Thoughts

from pyquery import PyQuery as pq import os from queue import Queue from threading < span style="color: #0000ff;">import Thread class txtparser(Thread): def __init__(self,queue): Thread.__init__(

September 28, 2021By Simo Web Crawler cooperation, ideas, multi-thread, reptileLeave a Comment

How to install PDFTK on Amazon Linux AMI version 2012.03

I cannot install pdftk on Amazon Linux AMI version 2012.03. pdftk requires gcj2.14 and amazon ami to provide the gcj2.12 package. If I try to install gcj2.14 with the existing gcj package A conflic

September 28, 2021By Simo Silicon Valley 2012.03, Amazon, AMI, How, installation, linux, PDFTK, versionLeave a Comment

Visual-Studio – Unable to build a DTProj [SSIS] item in Visual Studio

When I try to build a project with a .dtproj file in Visual Studio 2005, I receive an error message:

Make sure that the project type ( .dtproj) application.

This project is built on ano

September 28, 2021By Simo Visual Studio Studio, VISUALLeave a Comment

Visual-Studio-2010 – How to force TFS to let me download folders (except for the method listed)?

I have a seemingly common problem, but I can’t find a common solution that works for me. I recently re-imaged my computer and am now re-downloading the solution from TFS . One of the solution folde

September 28, 2021By Simo Visual Studio download, except, folder, forced, How, List, method, Studio, TFS, VISUALLeave a Comment

The code table in the field, the feeling of water is very deep

Code table in the field, I feel the water is deep I wrote a little crawler that crawls the code table, a long time ago
Now I want to analyze it carefully, the classification of the code, and writ

September 28, 2021By Simo Web Crawler code table, feel, Generation, In the field, very deep, waterLeave a Comment

Reptile automatically generates request head tutorial

Previous situation summary:

< span style="font-size: 18pt; color: #ff0000;">  The request header is a way of disguising the operator. Because the request header contains a lot of content;

September 28, 2021By Simo Web Crawler automatic, Crawl, generated, Head, Request, tutorialLeave a Comment

Where to go online ticket reptile

Recently, the company has a new requirement, that is, it needs to crawl the air ticket data of a certain day. Let me first crawl the data of Ctrip. Qunar. For Ctrip, it is still relatively simple,

September 28, 2021By Simo Web Crawler net, reptile, ticket, WhereLeave a Comment

[Python3 reptile] common anti-reptile measures and solutions (2)

This blog will continue to talk about common anti-crawler measures and our solutions. Similarly, if it helps you, please click a recommendation.

The anti-leech I encountered this time , In ad

September 28, 2021By Simo Web Crawler anti, common, measures, Python3 reptile, reptile, solution, twoLeave a Comment

Posts navigation

Page 1 … Page 413 Page 414 Page 415 … Page 590
Recent Posts
  • Sencha-Touch-2 – Sencha Touch 2, Nested XML Analysis NodeValue
  • Add a separation line and format XML content
  • Is there a norm of simplified XML subsets?
  • Look at it when you write React
  • ReactJS – Present React Redux React-Router App to add the server to the Firebase hosted by the Firebase
Categories
  • Android
  • Apache
  • Apache Kafka
  • Asp
  • Auto-Test
  • Automated Build
  • Aws
  • Bitcoin
  • Browser
  • C & C++
  • C#
  • Centos
  • Cgi
  • Character
  • Cloud Service
  • Cocos2dx
  • Cordova
  • CSS
  • Data Structure
  • Delphi
  • Design Pattern
  • Dojo
  • Dubbo
  • ELK
  • Flex
  • football
  • Game
  • Hadoop
  • Hibernate
  • HTML
  • Hybrid
  • Intel
  • IOS
  • Ipad
  • iPhone
  • Java
  • Javascript
  • Jetty
  • JQuery
  • Jsp
  • Linux
  • Load Balance
  • Lua
  • Macbook
  • Macos
  • Mathematics
  • Micro Services
  • Monitoring
  • Motherboard
  • Mysql
  • Network Hardware
  • Network Marketing
  • Nginx
  • NodeJs
  • Nosql
  • Oracle
  • Os Theory
  • Performance
  • PHP
  • Postgresql
  • Power Designer
  • React
  • Redis
  • Regexp
  • Rom
  • Rss
  • Ruby
  • Search Engines
  • Shell Script
  • Silicon Valley
  • Silverlight
  • Software Design
  • Spring
  • Sql
  • Sqlite
  • Sqlserver
  • Storage
  • Storm
  • Surface
  • SVN
  • Swift
  • System Architecture
  • Tablet
  • Uncategorized
  • Unix
  • Visual Basic
  • Visual Studio
  • Web Crawler
  • WebService
  • Windows
  • Wireless
  • XML
  • ZooKeeper
Archives
  • October 2021
  • September 2021
  • August 2021
  • May 2021
  • April 2021
  • September 2020
  • September 2019
  • August 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
© Simon Technology Blog 2026 • ThemeCountry Powered by WordPress