fb90 Testing a FreeBSD port - The FreeBSD Forums
The FreeBSD Forums  

Go Back   The FreeBSD Forums > Ports & Packages > Installation and Maintenance of FreeBSD Ports or Packages

Installation and Maintenance of FreeBSD Ports or Packages Installing and maintaining the FreeBSD Ports Collection or FreeBSD Packages (i.e. third party software).

Reply
 
Thread Tools Display Modes
  #1  
Old August 28th, 2009, 21:57
jack63ss jack63ss is offline
Junior Member
 
Join Date: Aug 2009
Posts: 2
Thanks: 0
Thanked 0 Times in 0 Posts
Cool Testing a FreeBSD port

Is there a standard test suite that can be used to validate a FreeBSD port to an embedded system ? I am primarily concerned about the kernel, but I do use some user space apps as well.
Thanks
Reply With Quote
  #2  
Old August 28th, 2009, 23:10
CodeBlock's Avatar
CodeBlock CodeBlock is offline
Member
 
Join Date: Jul 2009
Location: United States
Posts: 218
Thanks: 21
Thanked 11 Times in 11 Posts
Default

Not sure what you mean by testing a port. You could set up a tinderbox to test ports in a jailed environment. Or take a look at http://www.freebsd.org/doc/en/books/...g-testing.html and maybe http://www.freebsd.org/doc/en/books/...-portlint.html
__________________
Proud FreeBSD 8-RELEASE user.

CodeBlock on irc.freenode.net and irc.eighthbit.net.
Reply With Quote
  #3  
Old August 30th, 2009, 22:42
jack63ss jack63ss is offline
Junior Member
 
Join Date: Aug 2009
Posts: 2
Thanks: 0
Thanked 0 Times in 0 Posts
Default

By "testing the port" I meant a suite of tests that I can compile on my platform and execute to make sure all thge basic functions are working properly. For example, the Linux Test Project provides a set of tests to evaluate most Linux distributions. I was wondering if these was something similar for BSD ?
Reply With Quote
  #4  
Old August 30th, 2009, 22:55
SirDice's Avatar
SirDice SirDice is offline
Moderator
 
Join Date: Nov 2008
Location: Rotterdam, Netherlands
Posts: 13,702
Thanks: 47
Thanked 2,022 Times in 1,861 Posts
Default

Not sure if it's what you're looking for but have a look in /usr/src/tools/regression/.
__________________
Senior UNIX Engineer at Unix Support Nederland
Experience is something you don't get until just after you need it.
Reply With Quote
  #5  
Old August 31st, 2009, 15:19
CodeBlock's Avatar
CodeBlock CodeBlock is offline
Member
 
Join Date: Jul 2009
Location: United States
Posts: 218
Thanks: 21
Thanked 11 Times in 11 Posts
Default

Quote:
Originally Posted by jack63ss View Post
By "testing the port" I meant a suite of tests that I can compile on my platform and execute to make sure all thge basic functions are working properly. For example, the Linux Test Project provides a set of tests to evaluate most Linux distributions. I was wondering if these was something similar for BSD ?
Sound's like you're looking for ports-mgmt/portlint

http://www.freebsd.org/doc/en/books/...-portlint.html

This will check the syntax of the Makefile, as well as checking build, install, make package, and deinstall.
__________________
Proud FreeBSD 8-RELEASE user.

CodeBlock on irc.freenode.net and irc.eighthbit.net.
Reply With Quote
  #6  
Old September 1st, 2009, 04:43
ckester's Avatar
ckester ckester is offline
Member
 
Join Date: Nov 2008
Location: near Seattle, WA (USA)
Posts: 288
Thanks: 28
Thanked 36 Times in 31 Posts
Default

As you probably know, a FreeBSD port consists of a Makefile, a pkg-descr file, a distinfo file, and perhaps a pkg-plist files and some patchfiles in a files subdirectory. Portlint tests whether there are any syntax or semantics problems in those port files. It does NOT verify that the port will actually build or install correctly.

Many port maintainers use tinderbox to verify that their ports build, install and deinstall correctly -- and that all prerequisites are correctly specified. But here again, the only thing being tested is the build and install process, NOT the correct behavior of the applications or libraries so installed.

It's probably not possible to write a generic test program that is appropriate for all possible ports, because they all do different things. Test engineering is not a trivial task!

If the author of the software didn't provide a test suite, you're probably going to have to content yourself with some simple "smoke tests":

- Can you start up the application without it crashing?
- Do the most common and obvious features work as expected?
- If the application has a help system, does it work as expected?
- Etc.

How much of this kind of "poking around" you do is entirely up to you. But for most ports -- especially those that are known to work on other platforms -- passing simple smoke tests like these is usually enough to give you some confidence that it's at least as bug-free on FreeBSD as it is on those other platforms.
Reply With Quote
  #7  
Old September 1st, 2009, 04:53
ckester's Avatar
ckester ckester is offline
Member
 
Join Date: Nov 2008
Location: near Seattle, WA (USA)
Posts: 288
Thanks: 28
Thanked 36 Times in 31 Posts
Default

I just re-read your posts, and what I had to say might have missed the point.

It sounds like, when you say "port", you mean moving the FreeBSD kernel and userland to some previously unsupported hardware. If so, you might want to check with kernel developers. I'm sure they do have some sort of test suite that they might share with you.

In the FreeBSD world, "ports" refers to third-party software, i.e., stuff that's not part of FreeBSD itself.
Reply With Quote
  #8  
Old September 1st, 2009, 08:59
CodeBlock's Avatar
CodeBlock CodeBlock is offline
Member
 
Join Date: Jul 2009
Location: United States
Posts: 218
Thanks: 21
Thanked 11 Times in 11 Posts
Default

Ah, wow you are correct, I was thinking of ports-mgmt/porttools, not ports-mgmt/portlint.. Sorry about that.
__________________
Proud FreeBSD 8-RELEASE user.

CodeBlock on irc.freenode.net and irc.eighthbit.net.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[Solved] need help testing new port swills Porting New Software 1 January 2nd, 2010 21:42
Newbie : Testing Routing code ?? onkar Networking 1 July 20th, 2009 04:08
Information about the available tools for SCTP security testing promee Networking 0 July 8th, 2009 13:00
Any Plans to port FreeBSD to the IPod and MP4s cpu Embedded 4 January 7th, 2009 18:13


All times are GMT +1. The time now is 16:11.


Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2013, vBulletin Solutions, Inc.
The mark FreeBSD is a registered trademark of The FreeBSD Foundation and is used by The FreeBSD Project with the permission of The FreeBSD Foundation.
Web protection and acceleration provided by CloudFlare
0