首页
学习
活动
专区
圈层
工具
发布
社区首页 >问答首页 >Java 9多线程HTTP请求

Java 9多线程HTTP请求
EN

Stack Overflow用户
提问于 2018-03-08 17:56:35
回答 2查看 2.7K关注 0票数 0

我不知道如何正确地将以下顺序代码隐藏到多线程中。我已经尽力避免任何共享资源和完全独立线程。

这是single-threaded代码包com.net;

代码语言:javascript
复制
import jdk.incubator.http.HttpClient;
import jdk.incubator.http.HttpRequest;
import jdk.incubator.http.HttpResponse;
import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;

import java.io.IOException;
import java.net.URI;
import java.net.URISyntaxException;

public class ReqSingle {

    private float totalElapsedTime = 0F;
    private HttpClient client = HttpClient.newHttpClient();

    public ReqSingle(String[] sties){
        for (String site : sties){
            long fetchStartTime = System.currentTimeMillis();
            String html = getResource(site);
            float elapsed = (float) (System.currentTimeMillis() - fetchStartTime) / 1000;

            Document doc = Jsoup.parse(html);
            System.out.println("It took " + elapsed + " seconds to fetch " + site + " with title " + doc.title());
            totalElapsedTime += elapsed;
        }

        System.out.println("Total Elapsed Time: " + totalElapsedTime + "\nTotal Number of sites: " + sties.length);
    }

    private String getResource(String someUrl) {
        String body = "";
        try {
            URI url = new URI(someUrl);
            HttpRequest request = HttpRequest.newBuilder()
                    .uri(url).GET().build();
            HttpResponse<String> response = client.send(request, HttpResponse.BodyHandler.asString());
            body = response.body();
        } catch (URISyntaxException e) {
            System.out.println("URL " + someUrl + "is not valid");
        } catch (IOException | InterruptedException e) {
            // do nothing
        }
        return body;
    }
}

这是我实现的multi-threaded代码:

代码语言:javascript
复制
package com.net;

import jdk.incubator.http.HttpClient;
import jdk.incubator.http.HttpRequest;
import jdk.incubator.http.HttpResponse;
import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;

import java.io.IOException;
import java.net.URI;
import java.net.URISyntaxException;

public class ReqThreaded {

    public ReqThreaded(String[] sites) {

        for (String rawUri : sites) {
            new Thread(new Site(rawUri)).start();
        }
    }

    class Site implements Runnable {
        URI uri;

        public Site(String rawUri) {
            try {
                uri = new URI(rawUri);
            } catch (URISyntaxException e) {
                System.out.println("URL " + rawUri + "is not valid");
            }
        }

        @Override
        public void run() {
            String html = "";

            long fetchStartTime = System.currentTimeMillis();
            try {
                HttpClient client = HttpClient.newHttpClient();
                HttpRequest request = HttpRequest.newBuilder()
                        .uri(uri).GET().build();
                HttpResponse<String> response = client.send(request, HttpResponse.BodyHandler.asString());
                html = response.body();
            } catch (IOException | InterruptedException e) {
                //do nothing
            }
            float elapsed = (float) (System.currentTimeMillis() - fetchStartTime) / 1000;
            Document doc = Jsoup.parse(html);
            System.out.println("It took " + elapsed + " seconds to fetch " + uri.toString() + " with title " + doc.title());
        }
    }
}

这是测试器类,它的输出:

代码语言:javascript
复制
package com.net;

public class ReqTester {
    public static void main(String[] args) {

        String[] topIranianSites = {
                "https://www.aparat.com/",
                "http://www.varzesh3.com/",
                "http://namnak.com/",
                "http://www.telewebion.com/",
                "https://divar.ir/",
                "https://www.ninisite.com/",
                "https://www.blogfa.com/",
                "http://www.namasha.com/",
                "http://www.yjc.ir/"
        };

        System.out.println("Single Threaded Test Results:\n");
        new ReqSingle(topIranianSites);
        System.out.println("\n\nMulti Threaded Test Results:\n");
        new ReqThreaded(topIranianSites);

    }
}

输出:

代码语言:javascript
复制
WARNING: Using incubator modules: jdk.incubator.httpclient
Single Threaded Test Results:

It took 2.843 seconds to fetch https://www.aparat.com/ with title آپارات - سرویس اشتراک ویدیو
It took 0.459 seconds to fetch http://www.varzesh3.com/ with title 
It took 0.52 seconds to fetch http://namnak.com/ with title نمناک
It took 2.231 seconds to fetch http://www.telewebion.com/ with title تلوبیون | مرجع پخش زنده و دانلود فیلم ، سریال و سایر برنامه های تلویزیون
It took 0.243 seconds to fetch https://divar.ir/ with title 
It took 1.749 seconds to fetch https://www.ninisite.com/ with title نی نی سایت | راهنمای بارداری و بچه داری
It took 0.407 seconds to fetch https://www.blogfa.com/ with title 
It took 1.796 seconds to fetch http://www.namasha.com/ with title نماشا - سرویس رایگان اشتراک ویدیو
It took 0.232 seconds to fetch http://www.yjc.ir/ with title 
Total Elapsed Time: 10.48
Total Number of sites: 9


Multi Threaded Test Results:

It took 0.114 seconds to fetch https://divar.ir/ with title 
It took 0.236 seconds to fetch http://www.yjc.ir/ with title 
It took 1.519 seconds to fetch http://www.varzesh3.com/ with title 
It took 1.587 seconds to fetch https://www.blogfa.com/ with title 
It took 3.524 seconds to fetch http://namnak.com/ with title نمناک
It took 4.152 seconds to fetch https://www.ninisite.com/ with title نی نی سایت | راهنمای بارداری و بچه داری
It took 4.486 seconds to fetch http://www.namasha.com/ with title نماشا - سرویس رایگان اشتراک ویدیو
It took 4.725 seconds to fetch https://www.aparat.com/ with title آپارات - سرویس اشتراک ویدیو
It took 5.82 seconds to fetch http://www.telewebion.com/ with title تلوبیون | مرجع پخش زنده و دانلود فیلم ، سریال و سایر برنامه های تلویزیون
EN

回答 2

Stack Overflow用户

回答已采纳

发布于 2018-03-08 18:18:56

你的代码是正确的。但是建议使用一些遗嘱执行人服务实现来控制线程数。

例如:

代码语言:javascript
复制
ExecutorService executor = Executors.newFixedThreadPool(poolSize);
executor.submit(new Site(rawUri));

即使有大量的腊肠。它将保持对线程数量的点击。

票数 1
EN

Stack Overflow用户

发布于 2018-03-08 18:19:20

在您的示例中,没有理由自己创建线程;您可以简单地利用HttpClient#sendAsync。从其文件中:

使用此客户端和给定的响应处理程序异步发送给定请求。

此外,您应该使用JMH正确地对Java程序进行基准测试。请参阅:如何用Java编写正确的微基准测试?

票数 0
EN
页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接:

https://stackoverflow.com/questions/49179537

复制
相关文章

相似问题

领券
问题归档专栏文章快讯文章归档关键词归档开发者手册归档开发者手册 Section 归档