Luminati Proxy Manager
Luminati HTTP/HTTPS Proxy manager – GitHub
A forward HTTP/HTTPS proxy on your side, to accelerate/compress/rotate/distribute/manage/monitor/report/log/debug traffic to your proxies around the world.
With Proxy manager you can drive the Bright Data residential IPs or Bright Data static IPs.
This tool requires a Bright Data account.
Please report issues or bugs to your account manager or from our help center
Read this in 中文.
Features
Highly scalable
Connection pool for faster response time
Easy setup for multiple configurations using a simple web interface
Statistics
Automatically rotate IP every X requests
Load balancing using multiple Super Proxies
SSL analyzing (using a self-signed certificate)
SOCKSv5 proxy
Minimal requirements
2GB RAM
1 CPU
3GB HDD
Recommended requirements
4GB RAM
2 CPUs
3GB SSD
Installation
Windows
Download the Proxy Manager installer
Linux/MacOS – Install script
Run the setup script to install
wget -qO- | bash
Or
curl -L | bash
Linux/MacOS – Manual install
Install 12 ()
version for the proxy manager should be any at least 12. 18. 3
Make sure npm version is 6. 14. 6 or higher
if not, run: sudo npm install -g npm@6. 6
Install Proxy Manager from the terminal prompt:
sudo npm install -g @luminati-io/luminati-proxy
If you are trying to install the Proxy Manager from china on Mac/Linux please run the following command first to make sure npm is installing with allowed registry:
npm config set registry After this command ran successfully install using:
sudo npm install -g @luminati-io/luminati-proxy –allow-root
Upgrade
Use npm to upgrade
Or use the cli command:
Specific Version
To install a specific proxy manager version, choose a version from
releases
Run (VERSION_NUMBER is the version you’ve chosen (example: 1. 75. 355)):
sudo npm install -g @luminati-io/luminati-proxy@VERSION_NUMBER
Release Notes
You can review the for list of changes in every version
Usage
First run
After running the app for the first time:
Point your browser to the app admin UI
to set up credentials
and configure your proxies.
Run as daemon
To run the proxy manager in the background:
Dropin replacement for existing super-proxies
Proxy Manager comes with a “dropin mode” which behaves exactly like the
existing super-proxies. When running a proxy in dropin mode, you do not need to
sign in via the administrative UI in order to make requests through your
proxies. Rather, the proxy username and password are provided with each request
to the proxy server. This mode is enabled by default, and you can use this mode
as an easy replacement when migrating from the regular super-proxy to the Proxy
Manager.
Dropin mode is enabled by default. To disable the dropin proxy, use the flag
–no-dropin:
proxy-manager –no-dropin
For full documentation on the API for making requests through the dropin proxy,
see the
API Example page in your Bright Data account.
Complete list of command line options
proxy-manager –help
Usage:
proxy-manager [options] config1 config2…
Options:
–help, -h, -? Show help [boolean]
–version, -v Show version number [boolean]
–port, -p Port for the HTTP proxy [number]
–proxy_type Set to “persist” to save proxy into the
configuration file. [string]
–multiply Multiply the port definition given number of
times [number] [default: 0]
–multiply_users [boolean] [default: false]
–users List of users. This option has to be used along
with “multiply_users” [array]
–ssl Enable SSL analyzing [boolean] [default: false]
–tls_lib SSL library [string] [default: “open_ssl”]
–iface Interface or IP to listen on [string]
–customer Customer name [string]
–zone Zone name [string] [default: “static”]
–password Zone password [string]
–proxy Hostname or IP of super proxy
[string] [default: “”]
–proxy_port Super proxy port [number] [default: 22225]
–proxy_connection_type Determines what kind of connection will be used
between Proxy Manager and Super Proxy
–proxy_retry Automatically retry on super proxy failure
[number] [default: 2]
–insecure Enable SSL connection/analyzing to insecure
hosts [boolean]
–country Country [string]
–state State [string]
–city City [string]
–asn ASN [string]
–ip Data Center IP [string]
–vip gIP [number]
–ext_proxies A list of proxies from external vendors. Format:
[username:password@]ip[:port] [array]
–ext_proxy_username Default username for external vendor ips[string]
–ext_proxy_password Default password for external vendor ips[string]
–ext_proxy_port Default port for external vendor ips [number]
–dns DNS resolving [string]
–reverse_lookup_dns Process reverse lookup via DNS
[boolean] [default: false]
–reverse_lookup_file Process reverse lookup via file [string]
–reverse_lookup_values Process reverse lookup via value [array]
–session Session for all proxy requests
[string] [default: true]
–sticky_ip Use session per requesting host to maintain IP
per host [boolean] [default: false]
–pool_size [number]
–rotate_session Session pool size [boolean] [default: false]
–throttle Throttle requests above given number
[number] [default: “”]
–rules Proxy request rules [array]
–route_err Block or allow requests to be automatically sent
through super proxy on error
[string] [default: “pass_dyn”]
–smtp [array]
–override_headers [boolean]
–os Operating System of the Peer IP [string]
–headers Request headers [array]
–debug Request debug info default value
[string] [default: “full”]
–lpm_auth x-lpm-authorization header
[string] [default: “none”]
–const [boolean] [default: false]
–socket_inactivity_timeout [number] [default: 120000]
–multiply_ips [boolean] [default: false]
–multiply_vips [boolean] [default: false]
–max_ban_retries [number] [default: 10]
–preset [string] [default: “session_long”]
–ua Unblocker Mobile UA [boolean] [default: false]
–timezone Timezone ID to be used by the browser [string]
–resolution Browser screen size [string]
–webrtc WebRTC plugin behavior in the browser [string]
–whitelist_ips Default for all proxies whitelist ip list for
granting access to them [array] [default: []]
–www_whitelist_ips Whitelist ip list for granting access to browser
admin UI [array] [default: []]
–www HTTP and WebSocket port used for browser admin
UI and request logs [default: 22999]
–config Config file containing proxy definitions[string]
–mode Defines a set of permissible operations within
the UI/API [string]
–dropin Create dropin mode proxy port (default: 22225)
[boolean] [default: true]
–dropin_port Port for dropin mode [default: 22225]
–no_usage_stats Disable collection of usage statistics
–lpm_token An authorization token [string]
–high_perf [boolean] [default: false]
–zagent [boolean] [default: false]
–cluster [string] [default: true]
–sync_config Synchronize Proxy Manager configuration with the
cloud [boolean] [default: false]
–sync_zones [boolean] [default: true]
–sync_stats [boolean] [default: true]
–request_stats Enable requests statistics
–test_url Url for testing proxy
[string] [default: “]
–log Log level [string] [default: “notice”]
–logs Number of request logs to store
[number] [default: 1000]
–har_limit Number of bytes to store[number] [default: 1024]
–ports_limit Limit the numer of open proxy ports at the same
time [default: 10000]
–ui_ws Enable live logs preview and other live data
communication on the UI[boolean] [default: true]
–force Kill other instances of Proxy Manager if there
are any [boolean] [default: false]
–session_termination Stop sending new requests when the peer IP
becomes unavailable and redirect to confimration
page before new IP is taken
–api Alternative url to luminati API [string]
–api_domain Alternative domain url to luminati API
–local_login Requires each browser to authenticate against
Proxy Manager [boolean] [default: false]
–read_only Avoid saving current config in the config file
–extra_ssl_ips List of IPs to add to SSL certificate
[array] [default: []]
–no-www Disable local web
–no-config Working without a config file
–daemon, -d, –start-daemon Start as a daemon
–restart-daemon Restart running daemon
–stop-daemon Stop running daemon
–delete-daemon Delete daemon instance
–upgrade Upgrade proxy manager
–downgrade Downgrade proxy manager (if backup exists on
disk)
–dir Path to the directory with database and
configuration files
–status Show proxy manager processes current status
–gen-cert Generate cert
–auto-upgrade Enable auto upgrade
–start-upgrader Install CRON process that checks upgrades
–stop-upgrader Removes CRON process that checks upgrades
–insecure–parser Disables the strict checks
–proxy_country [default: “”]
–bw_limit [default: 0]
–info [default: false]
–cn [default: false]
–api_body_limit [default: “2mb”]
–api_domain_fallback [default: “”]
Docker
A docker image can be found on docker pull luminati/luminati-proxy
docker run luminati/luminati-proxy proxy-manager
docker run luminati/luminati-proxy proxy-manager –version
Make sure to forward appropriate ports. Proxy manager uses by default 22999
for the web console and the api, 22225 for dropin and 24000 for first
configurable proxy.
To run docker with cli option see the below example:
docker run luminati/luminati-proxy proxy-manager –www_whitelist_ips “172. 17. 0. 1” –ssl true
You can add many more options to this run.
Docker with predefined config file
To use lpm’s config file, docker volumes can be used:
Following these instructions will make your docker run with a specific config file:
create volume
docker volume create lpm-vol
Inspect the recently created volume
Should output something like this:
[
{
“CreatedAt”: “2018-02-01T12:59:58+02:00”,
“Driver”: “local”,
“Labels”: null,
“Mountpoint”: “/var/lib/docker/volumes/lpm-vol/_data”,
“Name”: “lpm-vol”,
“Options”: {},
“Scope”: “local”}]
Take the mountpoint path /var/lib/docker/volumes/lpm-vol/_data and run
cd /var/lib/docker/volumes/lpm-vol/_data
put. to this directory (here also will be the logs and other
files generated by the container)
run docker image and attach this volume:
docker run –rm –name ‘lpm1’ –mount source=lpm-vol, target=/root
“luminati/luminati-proxy” proxy-manager
SSL Requests
The –ssl parameter is for SSL analyzing, HTTPS requests can be made without it.
Help
The FAQ can be found on the Bright Data
FAQ
If you do not find the answer there, feel free to open an
issue on github.
Or contact
REST API
Working documentation of the API can be found inside the app.
The API also can be found on the Bright Data here
Proxy Manager – Bright Data
Waterfall routingThrough multiple IP typesReduced bandwidthWith custom rulesWaterfall routingRoute requests through residential, data-center and mobile IP networks based on custom rules to get the most cost-effective bandwidthUse Proxy Manager features such as regex and custom rules to reduce trafficRequest viewerBrowse and monitor all requests sent through a proxy with detailed request logsInstall Proxy ManagerHow to install the Proxy ManagerLatest version: X. X. XWindows installerBash install script (recommended for Mac OS and Linux)Github source codeMinimal requirements:1 CPU2GB RAM3GB HDDRecommended requirements:2 CPUs4GB RAM3GB SSDHow to run the Proxy ManagerMake sure the Proxy Manager is activated1. Download Windows installer 2. Click Start then search for Proxy Manager3. Wait until it boot4. If a new browser window is not popping up, open a browser and navigate to 127. 0. 1:22999Watch our tutorial video. Experiencing any problems with Proxy Manager? Read our FAQ. Previous versions Getting started is easy! Just download the Proxy Manager based on your requirements and get your web data extraction projects up and running today! Start Now
How to start using the Luminati Proxy Manager – BrightTALK
Upcoming talks (0)On-demand talks (8)Subscribers (239)Learn to scrape like a professional. Understand the web data mining environment along with common blocking techniques and how to overcome them.
About Luminati:
Luminati () is the world’s largest network of Residential IPs that enables viewing the web as is seen by real consumers across the globe.
Serving fortune 500 companies, Luminati is the only proxy network that works hard at being fully compliant resulting in a high-quality, high integrity network. …
Frequently Asked Questions about luminati proxy manager
What is luminati proxy manager?
Luminati (http://luminati.io) is the world’s largest network of Residential IPs that enables viewing the web as is seen by real consumers across the globe. Serving fortune 500 companies, Luminati is the only proxy network that works hard at being fully compliant resulting in a high-quality, high integrity network.
How do I install luminati proxy manager?
How to install the Proxy ManagerWindows installer. exe file v.X.X.X.NPM package. sudo npm install -g @luminati-io/luminati-proxy.Docker image. docker pull luminati/luminati-proxy.Github source code.
Who is a proxy manager?
A proxy manager is software designed to manage a computer network’s proxy servers, write and implement their policies and filter resource requests. Proxy servers act as a gatekeeper for your company’s computer terminals and the Internet, ensuring security and productivity.
