Airac's Performance

Airac homepage

Scalability


Figure 1	Figure 2

Above two figures show Airac's scalability behavior. X axis is the size (# of lines) of the input program to analyze. Y axis is the analysis time in seconds. Figure 2 is a microscopic graph of Figure 1's lower left corner.

Analysis Cost and Accuracy

The following table shows Airac's analysis speed and accuracy data. (For a comparison with other existing tools, click here.)

#Lines: the number of lines of the C source files, before preprocessing their header files.
Time: CPU user seconds on Pentium4 3.2GHz. Analyzing GNU and Linux packages were on 4GB RAM and company A's on 2GB.
Airac Alarms
- #Buffers: the number of buffers that may be overrun.
- #Accesses: the number of buffer-access expressions that may overrun.
#Real Bugs: the number of buffer-access expressions that can really overrun.
#Buffer Accesses: the total number of buffer-access expressions in the program.

Class	Software	#Lines	Time(sec)	#Airac Alarms		#Real Bugs	#Buffer Accesses
Class	Software	#Lines	Time(sec)	#Buffers	#Accesses	#Real Bugs	#Buffer Accesses
GNU S/W	tar-1.13	20258	576.79s	24	66	1	2630
	bison-1.875	25907	809.35s	28	50	0	5164
	sed-4.0.8	6053	1154.32s	7	29	0	461
	gzip-1.2.4a	7327	794.31s	9	17	0	799
	grep-2.5.1	9297	603.58s	2	2	0	187
Linux Kernel (version 2.6.4)	vmax302.c	246	3.02s	1	1	1	79
	xfrm_user.c	1201	91.21s	2	5	4	235
	usb-midi.c	2206	133.18s	2	10	4	332
	atkbd.c	944	407.55s	3	5	2	332
	keyboard.c	1256	38.56s	5	6	1	411
	af_inet.c	1273	79s	1	1	1	48
	eata_pio.c	984	47.65s	3	5	1	183
	cdc-acm.c	849	347.68s	3	5	3	468
	ip6_output.c	1110	89.74s	0	0	0	198
	mptbase.c	6158	3299.07s	3	3	1	777
	aty128fb.c	2466	12.23s	1	1	1	98
Commercial S/W	sw T	109878	4525.02s	16	64	0
	sw U	17885	463.60s	8	18	9
	sw S	3254	5.94s	17	57	0
	sw SD	29972	457.38s	10	140	112
	sw DD	19263	8912.86s	7	100	3
	sw DC	36731	43.65s	11	48	4
	sw DS	138305	38328.88s	34	147	47
	sw Es	233536	4285.13s	28	162	6
	sw El	47268	2458.03s	25	273	1

Last updated: Tue Aug 31 13:55:02 2021 +0900