nodejs压力测试

背景

随着公司的业务的扩展，并发也越来越高，随着并发的变高，必然会带来很多问题，比如响应变慢，响应超时，甚至服务宕机，为了能够更好的处理此类问题，我们必须了解nodejs的基础性能，下面就是针对以下两种情况做的压力测试。

• nodejs每秒钟能处理多少个简单请求

• nodejs每秒中能够处理多少个简单查询数据库的请求

准备条件

• server: 原生nodejs搭建一个http服务，每个请求返回1k的数据, node version:10

const http = require('http');

let port = process.env.port | 3000

http.createServer(app).listen(port, () => {
    console.log(`server is listening ${port}`)
})

let num = 0;
function app(req, res) {
    console.log(`第${num++}次访问`)
    res.end(getdata().toString())
}

function getdata() {
    let size = 1 * 1024
    let arr = new Array(size)
    for (let i = 0; i < arr.length; i++) {
        arr[i] = 1
    }
    return arr;
}

• ab压力测试工具

• 硬件条件

  阿里云 Ubuntu，8G，2CPU

测试场景一

请求10000次，并发分别为10 100 1000 5000 10000

ab -n10000 -c10 http://localhost:3000/

Concurrency Level:      10
Time taken for tests:   1.763 seconds
Complete requests:      10000
Failed requests:        0
Total transferred:      21220000 bytes
HTML transferred:       20470000 bytes
Requests per second:    5672.22 [#/sec] (mean)
Time per request:       1.763 [ms] (mean)
Time per request:       0.176 [ms] (mean, across all concurrent requests)
Transfer rate:          11754.35 [Kbytes/sec] received

ab -n10000 -c100 http://localhost:3000/

Concurrency Level:      100
Time taken for tests:   1.338 seconds
Complete requests:      10000
Failed requests:        0
Total transferred:      21220000 bytes
HTML transferred:       20470000 bytes
Requests per second:    7472.81 [#/sec] (mean)
Time per request:       13.382 [ms] (mean)
Time per request:       0.134 [ms] (mean, across all concurrent requests)
Transfer rate:          15485.66 [Kbytes/sec] received

ab -n10000 -c1000 http://localhost:3000/

Concurrency Level:      1000
Time taken for tests:   1.489 seconds
Complete requests:      10000
Failed requests:        0
Total transferred:      21220000 bytes
HTML transferred:       20470000 bytes
Requests per second:    6713.89 [#/sec] (mean)
Time per request:       148.945 [ms] (mean)
Time per request:       0.149 [ms] (mean, across all concurrent requests)
Transfer rate:          13912.97 [Kbytes/sec] received

ab -n10000 -c5000 http://localhost:3000/

Concurrency Level:      5000
Time taken for tests:   2.179 seconds
Complete requests:      10000
Failed requests:        0
Total transferred:      21220000 bytes
HTML transferred:       20470000 bytes
Requests per second:    4589.91 [#/sec] (mean)
Time per request:       1089.345 [ms] (mean)
Time per request:       0.218 [ms] (mean, across all concurrent requests)
Transfer rate:          9511.52 [Kbytes/sec] received

ab -n10000 -c10000 http://localhost:3000/

Concurrency Level:      10000
Time taken for tests:   1.870 seconds
Complete requests:      10000
Failed requests:        0
Total transferred:      21220000 bytes
HTML transferred:       20470000 bytes
Requests per second:    5348.45 [#/sec] (mean)
Time per request:       1869.701 [ms] (mean)
Time per request:       0.187 [ms] (mean, across all concurrent requests)
Transfer rate:          11083.41 [Kbytes/sec] received

总结

在本地环境，基本不考虑网络因素，不考虑每个请求返回1KB数据，TPS能够达到7000~1100, 并不是并发越大请求越快，两则之间不存在线性关系

测试场景二

基于上述程序，添加连接mongodb，每次查询大小为1kb的数据，返回，测试

const http = require('http');

let port = process.env.port | 3000

http.createServer(app).listen(port, () => {
    console.log(`server is listening ${port}`)
})

let num = 0;
function app(req, res) {
    console.log(`第${num++}次访问`)
    getDataFromDb(res)
}

function getdata() {
    let size = 1 * 1024
    let arr = new Array(size)
    for (let i = 0; i < arr.length; i++) {
        arr[i] = 1
    }
    return arr;
}

function getDataFromDb(res){
let data = Blog.findOne({},(err,result) => {
res.end(result.toString())
})
}

const mongoose = require("mongoose")
mongoose.connect('mongodb://localhost:30001/tim', {useNewUrlParser: true});
const Schema = mongoose.Schema;
const blogSchema = new Schema({
  title: String,
  body: []
});
const Blog = mongoose.model('Blog', blogSchema);
let obj = {title:"tim",body:getdata()}
const post = new Blog(obj);
post.save()

请求10000次，并发分别为10 100 150

ab -n10000 -c10 http://localhost:3000/

Concurrency Level:      10
Time taken for tests:   12.923 seconds
Complete requests:      10000
Failed requests:        0
Total transferred:      11690000 bytes
HTML transferred:       10940000 bytes
Requests per second:    773.84 [#/sec] (mean)
Time per request:       12.923 [ms] (mean)
Time per request:       1.292 [ms] (mean, across all concurrent requests)
Transfer rate:          883.41 [Kbytes/sec] received

ab -n10000 -c100 http://localhost:3000/

Concurrency Level:      100
Time taken for tests:   11.268 seconds
Complete requests:      10000
Failed requests:        0
Total transferred:      11690000 bytes
HTML transferred:       10940000 bytes
Requests per second:    887.44 [#/sec] (mean)
Time per request:       112.684 [ms] (mean)
Time per request:       1.127 [ms] (mean, across all concurrent requests)
Transfer rate:          1013.10 [Kbytes/sec] received

ab -n10000 -c1000 http://localhost:3000/

Concurrency Level:      1000
Time taken for tests:   12.815 seconds
Complete requests:      10000
Failed requests:        0
Total transferred:      11690000 bytes
HTML transferred:       10940000 bytes
Requests per second:    780.33 [#/sec] (mean)
Time per request:       1281.508 [ms] (mean)
Time per request:       1.282 [ms] (mean, across all concurrent requests)
Transfer rate:          890.83 [Kbytes/sec] received

ab -n10000 -c5000 http://localhost:3000/

Concurrency Level:      5000
Time taken for tests:   19.061 seconds
Complete requests:      10000
Failed requests:        0
Total transferred:      11690000 bytes
HTML transferred:       10940000 bytes
Requests per second:    524.63 [#/sec] (mean)
Time per request:       9530.570 [ms] (mean)
Time per request:       1.906 [ms] (mean, across all concurrent requests)
Transfer rate:          598.92 [Kbytes/sec] received

```ab -n10000 -c10000 http://localhost:3000/``

Concurrency Level:      10000
Time taken for tests:   12.900 seconds
Complete requests:      10000
Failed requests:        0
Total transferred:      11690000 bytes
HTML transferred:       10940000 bytes
Requests per second:    775.19 [#/sec] (mean)
Time per request:       12900.048 [ms] (mean)
Time per request:       1.290 [ms] (mean, across all concurrent requests)
Transfer rate:          884.96 [Kbytes/sec] received

总结

当有数据库操作时TPS在500～800左右，也就是平时我们的代码性能很好的情况下，如果存在数据库操作，单个实例TPS在500～800左右， 并发对TPS有较小影响

测试5000并发过程发生错误 apr_socket_recv: Connection reset by peer (104)

内核会认为系统受到了SYN flood攻击，会发送cookies（possible SYN flooding on port 80. Sending cookies），这样会减慢影响请求的速度，所以在应用服务武器上设置下这个参数为0禁用系统保护就可以进行大并发测试了：

# vim /etc/sysctl.conf 

net.ipv4.tcp_syncookies = 0

# sysctl -p

然后就可以超过5000个并发测试了

Notes 如果高并发出现错误Apache Bench test error on OS X: “apr_socket_recv: Connection reset by peer (54)”，请参考这篇文章 ，如果更新过程出现错误 configure: error: APR not found . Please read the documentation,请参考这篇文章