Advanced Email Scraper (AES) - SAAS
Thank you so much for purchasing this application. I'd be glad to help you if you have any questions relating to this app.
Advanced Email Scraper (AES) - SAAS is a web based tool to extract emails by various techniques (website crawl, URL crawl, search in Google/Bing, searcn in txt/doc/docx/pdf/json/xml), check email validation (patter, MX record) , search for whois data, filter your email list by removing duplicate emails, check web page status, decode email string etc. It is designed carefully so that you can install & use it very easily.
SAAS stands for Software As A Service. This product is identical to our another product Advanced Email Scraper (AES) except that you can receive monthly payment from your users if you buy the extended license. Your users can pay you through paypal & stripe.

- Awesome responsive front-end
- User management
- Payment management (paypal & stripe integration)
- Send email to your users
- Decode modified email string
- Full website crawling (no subdomain)
- URL crawling (bulk upload)
- Search in Google, Bing with keywords (proxy is recommended)
- Whois search (bulk)
- Search in txt/doc/docx/pdf/json/xml file (bulk file upload)
- Email validation check (patter, MX)
- Email filtering (remove duplicate email)
- Bulk page status check (56 HTTP code)
- Download .zip package
- Upload it to your server
- Extract the package (make sure all the folders have write permission)
- Run the uploaded url via browser (http://yourdomain.com/sub1/sub2/.../aes/) and you will find this interface. Here you have to provide the settings for AES:
- Hostame : database host name / IP
- Database Name : create a mysql database for AES on your host and write that name here
- Database username : username of the created database
- Database password : password of the created database
- AES Admin Panel Login Email : this email will be used to login as admin
- AES Admin Panel Login Password : password to log in as admin
- Company Name and Company Address
- Company Phone / Mobile
-

- Click Install AES Now Button
- You are done. Log in with your admin email and password and start using AES.
You will see similar types of interface everywhere because our design team tried to make the whole interface easy to learn and remember. So, if you know what is where in this interface below, you can explore a lot very easily.
- It's the main navigation. You will find every link here.
- Clicking here an user can change his/her password or can sign out.
- In this area you will find functionalities like new search/ download.
- You will find some pages with data loaded in a nice data-grid. You can filter the shown data by searching.
- Data are always loaded with pagination for better performance. You will find the pagination information here and can manipulate pagination options.
- It's called the the "Action Area". If you want to view / edit / delete etc a record in data-grid you have to use the action area.

AES contains a nice responsive front end so that you can use it as your langing page. Your users will sign up and log in from this front end. If you want to customize the front end then you will find ..../aes/aes_website folder where all front end assets are strored and .../aes/application/views/aes_website folder, the front end page.
Dashboard is the langing page of admin panel and contains graphical report of all recent activities.
General Settings
- Click it and you will find a form to customize the settings.
- This is the place where you can change the logo & favicon also.
- Here is the snapshot.Happy customization


Email SMTP Settings
- It is a multi user application, so you can send email to user users. You can configure AES with your SMTP server's settings.

-
AES SaaS is a muti-user application with the SaaS (Software as a Service) functionality.
-
It consists of two types of user : admin level & user level (end user)
Admin will configure the system through general settings, email settings payment settings etc while end users will use the system & will pay monthly service charge for using the system. It has feature to recieve payment via PayPal & Stripe.
-
In user management admin users will have access to add, view, disable, enable, edit, reset password, delete users.
Note: if you add an user manually, then after addition edit the user to assign subscription package and expiry date manually.
User List
User Add Form
User Edit Form [Package assign]

- You can send email notification to your users
- Select users and click Send Email, type subject and message and then click Send.


Payment Dashboard
Payment dashboard is visual report of fees paid by users.

Payment Settings
Configure your paypal/stripe account & currency here to receive payments from your users.

Package Settings
- You can create subscription plans or packages here. The system will automatically create a package named "Trial" with 7 days validity, so that, your users can try it and remeber that you can not delete this default package.

- Suppose you want to create a package named "basic" which validity will be 10days, price will be USD 30 and you want to assign specific modules (i.e. Crawl URL & Whois Search) for this package. In this case you are lucky!! You can add unlimited packages you want including price,validity and modules. You can also put monthly analysis limit & bulk processing limit for each module when you create a package. While you assign limits, 0 (zero) means unlimited. For Visitor Analysis the analysis limit is not monthly, it means number of active sites under visitor analysis at a time. The bulk limit means the maximum number of request can be processed at a time.

- If you do not want a trial then edit deafult package's validity to 0 (zero).

- If you do not want to take money from users then edit the default package's price to "Free".

Payment History

Your targetted site's email may be modified like konok[at]gmail[dot]com or something else.
Here you can set which string should be replaced with what,as for example: [dot] = . or [at] = @
These settings will be applied when you scrap emails from websites.
AES can decrypt, ecrypted mail automatically.
-
Collecting email from a website is now super easy.
-
Go to Crawl Website > New Search
-
You just need to put the domain name and hit Start Scraping button. The system then start to crawl all links of this website and collect all email address. The progress of each links will be displayed after completing with found email.
-
At the end you’ll get all urls and email address which is fetched from the website. You can download email list and url list then.
-
Also these scraping information will be stored in the database and you can access it anytime. Here you will find advance search option also.
-
Please note that this tool can’t read date which is displayed with Javascript or with auto search. Some websites crawling needs to use proxy. So there is optional option to use proxy. If you think proxy is needed to crawl the site, use proxy.



-
If you want to scrap specific url not the full website, then this option is appropriate.
-
The system supports multiple url crawling at a time.
-
Go to Crawl URL> New Search.You can simply type URLs in new lines or type as comma separated string in the appeared text area or uplaod comma seperated/new line seperated text/csv file.
-
Then hit Search button and searching will start .
-
You can download email address after completion.
-
The scraping information will be stored in the database and you can access it anytime through landning page of Crawl URL.


-
Search engine is the greatest place for getting email address. To search for emails in search engines go to Search in Search Engine > New Search
-
Search engines provide results depebding on keyword. So you need to put your keyword.
-
Then select your search engine (Google or Bing).
-
The email addresses come from some popular social networks usually. Select your social network from where you want to collect.
-
Then select the email provider like gmail, yahoo, outlook. It means which provider’s email you want.
-
Download your desired email list.
-
Important: Crawling in Google or Bing is very sensitive. They may band or block your IP for continuous crawling. So we strongly recommend you to use proxy during Google or Bing search. Our system supports proxy system with very easy interface.
-
The scraping information will be stored in the database and you can access it anytime through landning page of Search in Search Engine.



- Let, you have a lot of text/json/xml files in your hard drive where email may exist.
- This feature will help you to search in those files and collect emails.
- You can aslo upload multiple files at a time, browse them and hit Start Searching.

- After completion you can download the result.

- Let, you have a lot of doc/docx/pdf files in your hard drive where email may exist.
- This feature will help you to search in those files and collect emails.
- You can aslo upload multiple files at a time, browse them and hit Start Searching.

- After completion you can download the result.

-
If you need any domain's whois information like admin email, technical email, nameserver, registration date, sponsor, expiry date, then here is the solution.
-
It supports bulk domain search. you can simply type domains in new lines or type as comma separated string in the appeared text area or uplaod comma seperated/new line seperated text/csv file.
-
Hit Start Searching and after completion download the result.
-
The searching information will be stored in the database and you can access it anytime through landning page of Whois Search.


-
Check emails are valid or not.
-
AES supports well pattern matching and MX record for checking valid emails.
-
AES does not support SMTP validation becasue there are some drawbacks to use SMTP validation. Most of the SMTP servers take it as spam and we get wrong wrong result.
-
You can simply type emails in new lines or type as comma separated string in the appeared text area or uplaod comma seperated/new line seperated text/csv file.
-
Hit Start Searching and after completion download the result.


-
This is a very simple technique to remove duplicate emails and make your email list unique.
-
You can simply type emails in new lines or type as comma separated string in the appeared text area or uplaod comma seperated/new line seperated text/csv file.
-
Hit Start Searching and after completion download the result.


-
Let you have a lot of URLs of domains.
-
You may need to check the status of all URLs.
-
Some of the URLs may be down or not found or broken.
-
AES handles all 56 HTTP code responses and give you exact status & HTTP response code.
-
It will also return connected time, download speed, name lookup time etc.
-
You can simply type URLs in new lines or type as comma separated string in the appeared text area or uplaod comma seperated/new line seperated text/csv file.
-
Hit Start Searching and after completion download the result.
-
The searching information will be stored in the database and you can access it anytime through landning page of Page Status Checker.


Update - v2.0 v2.1
1.Download v2.1
2. Copy & replace the follwoing files / folders
- application/controllers folder
- application/libraries folder
- application/helpers folder
- cookie folder
- application/views/admin/advance/whois_search.php
- application/views/admin/searchengine_search.php
- application/views/admin/admin_payment_history.php
- application/views/member/member_payment_history.php
3. Run the following SQL query to your database via phpmyadmin
ALTER TABLE `whois_search` ADD `admin_name` VARCHAR( 250 ) NULL AFTER `admin_email` ,
ADD `registrant_name` VARCHAR( 250 ) NULL AFTER `admin_name` ,
ADD `admin_phone` VARCHAR( 100 ) NULL AFTER `registrant_name` ,
ADD `registrant_phone` VARCHAR( 100 ) NULL AFTER `admin_phone`;
ALTER TABLE `transaction_history` ADD `stripe_card_source` TEXT NOT NULL ;
ALTER TABLE `payment_config` ADD `stripe_secret_key` VARCHAR( 150 ) NOT NULL AFTER `paypal_email` ;
ALTER TABLE `payment_config` ADD `stripe_publishable_key` VARCHAR( 150 ) NOT NULL AFTER `stripe_secret_key` ;
4.Open application/config/my_config.php and update line 5 to v2.1
5.You are done.
Update - v1.2 v2.0
1.Download v2.0
2. Replace your aes_website/*, application/controllers/* , application/helpers/*, application/language/*, application/libraries/*, application/views/*, assets/images/paypal_btn.png, documentation/*, system/* taking from v2.0
3. Run the migration file via browser. Example link http://yourdomain.com/sub1/sub2/.../aes_saas/update
4.Open application/config/my_config.php and update line 5 to v2.0
5.You are done.